Oct 30 21:39:38.668166 ip-10-0-139-66 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 21:39:38.668177 ip-10-0-139-66 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 21:39:38.668183 ip-10-0-139-66 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 21:39:38.668410 ip-10-0-139-66 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 21:39:48.768220 ip-10-0-139-66 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 21:39:48.768234 ip-10-0-139-66 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 871ffe7f1c824400ad9a96e5f83e420e --
Oct 30 21:42:01.607964 ip-10-0-139-66 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:42:02.080695 ip-10-0-139-66 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:42:02.080695 ip-10-0-139-66 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:42:02.080695 ip-10-0-139-66 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:42:02.080695 ip-10-0-139-66 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:42:02.088613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088484    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.088613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088612    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.088613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088619    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088624    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088629    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088633    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088637    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088642    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088662    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088667    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088671    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088676    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088680    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088685    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088690    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088694    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088698    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088702    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088706    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088710    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088714    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.088739 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088719    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088723    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088735    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088740    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088745    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088750    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088755    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088759    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088763    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088767    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088771    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088776    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088780    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088784    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088788    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088792    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088795    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088800    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088804    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088808    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.089182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088812    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088816    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088821    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088825    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088830    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088834    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088838    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088842    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088847    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088851    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088854    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088858    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088865    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088869    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088874    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088878    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088882    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088887    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088891    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088895    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.089675 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088899    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088903    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088906    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088910    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088916    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088920    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088923    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088928    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088932    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088936    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088940    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088948    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088955    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088961    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088966    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088969    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088974    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088978    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088983    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.090162 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088989    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.088995    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089000    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089004    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089009    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089013    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089017    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089022    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089026    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089031    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089035    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089039    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089043    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089047    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089051    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089054    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089058    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089062    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089066    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089070    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.090613 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089074    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089078    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089083    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089088    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089091    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.089104    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090186    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090196    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090201    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090206    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090210    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090214    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090218    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090222    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090226    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090231    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090235    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090241    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090246    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.091111 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090251    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090255    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090259    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090264    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090268    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090272    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090276    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090281    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090284    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090289    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090293    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090296    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090300    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090304    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090310    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090314    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090318    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090323    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090327    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090332    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.091572 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090336    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090341    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090345    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090349    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090354    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090358    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090363    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090367    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090371    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090375    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090379    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090383    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090387    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090391    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090395    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090400    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090404    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090410    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090429    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090434    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.092085 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090438    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090442    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090447    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090451    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090454    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090459    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090463    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090467    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090472    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090476    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090480    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090483    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090488    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090495    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090501    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090505    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090510    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090514    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.092726 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090520    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090526    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090531    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090535    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090540    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090544    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090548    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090552    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090556    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090560    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090563    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090567    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090571    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090575    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090579    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090583    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090587    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090590    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090595    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090599    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.093157 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090604    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090608    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090612    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090617    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090621    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090625    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090630    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090634    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090639    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090643    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090660    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090665    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090669    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090673    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.090677    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092305    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092315    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092320    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092324    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092328    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.093640 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092333    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092338    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092342    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092346    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092350    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092354    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092359    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092363    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092367    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092371    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092375    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092380    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092385    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092389    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092393    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092397    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092401    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092406    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092410    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092414    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.094189 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092419    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092423    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092427    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092431    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092435    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092440    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092444    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092448    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092453    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092457    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092460    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092464    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092468    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092472    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092476    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092480    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092484    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092488    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092493    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.094699 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092497    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092501    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092505    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092509    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092514    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092518    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092523    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092526    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092531    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092535    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092539    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092543    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092547    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092552    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092559    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092565    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092570    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092575    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092579    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.095144 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092583    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092587    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092592    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092595    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092600    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092604    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092609    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092612    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092616    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092620    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092624    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092628    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092632    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092636    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092640    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092658    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092663    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092667    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092673    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.095586 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092679    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092685    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092690    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092695    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092699    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092703    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092708    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092712    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092718    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092722    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092728    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092732    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092737    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092742    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092746    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092750    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092754    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092758    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092762    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092766    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.096080 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092770    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092774    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092777    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.092781    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095273    2579 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095289    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095300    2579 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095308    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095315    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095320    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095327    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095335    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095340    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095345    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095351    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095356    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095361    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095366    2579 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095371    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095376    2579 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095380    2579 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095386    2579 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095392    2579 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:42:02.096546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095396    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095401    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095406    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095411    2579 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095417    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095422    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095426    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095431    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095436    2579 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095441    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095445    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095450    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095455    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095462    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095467    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095471    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095476    2579 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095481    2579 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095486    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095493    2579 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095499    2579 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095504    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095509    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095514    2579 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:42:02.097097 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095520    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095526    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095530    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095535    2579 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095540    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095545    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095550    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095555    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095559    2579 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095564    2579 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095569    2579 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095576    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095580    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095585    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095589    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095594    2579 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095599    2579 flags.go:64] FLAG: --help="false"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095605    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095609    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095614    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095619    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095625    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095630    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:42:02.097798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095635    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095640    2579 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095657    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095662    2579 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095667    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095672    2579 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095677    2579 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095682    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095687    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095692    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095696    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095701    2579 flags.go:64] FLAG: --lock-file=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095705    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095710    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095715    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095723    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095728    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095733    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095738    2579 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095743    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095748    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095753    2579 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095757    2579 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095764    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095769    2579 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:42:02.098358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095776    2579 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095780    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095785    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095790    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095794    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095800    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095804    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095809    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095820    2579 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095825    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095830    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095835    2579 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095840    2579 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095844    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095849    2579 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095853    2579 flags.go:64] FLAG: --port="10250"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095858    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095862    2579 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0067a7960d8efacc6"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095868    2579 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095872    2579 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095877    2579 flags.go:64] FLAG: --register-node="true"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095882    2579 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095888    2579 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095893    2579 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095897    2579 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095902    2579 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:42:02.099013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095908    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095913    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095919    2579 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095923    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095928    2579 flags.go:64] FLAG: --runonce="false"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095932    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095937    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095942    2579 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095946    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095950    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095956    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095960    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095965    2579 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095970    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095974    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095979    2579 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095983    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095987    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095992    2579 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.095996    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096003    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096008    2579 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096012    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096018    2579 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096022    2579 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:42:02.099643 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096026    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096030    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096035    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096040    2579 flags.go:64] FLAG: --v="2"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096047    2579 flags.go:64] FLAG: --version="false"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096053    2579 flags.go:64] FLAG: --vmodule=""
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096059    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096065    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096265    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096272    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096276    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096280    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096284    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096289    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096293    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096297    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096301    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096306    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096310    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096314    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096319    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.100293 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096323    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096326    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096330    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096334    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096338    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096343    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096347    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096352    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096357    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096363    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096368    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096372    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096378    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096384    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096389    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096393    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096397    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096401    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096405    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.100827 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096410    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096414    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096418    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096422    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096427    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096431    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096435    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096439    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096443    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096450    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096454    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096459    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096462    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096466    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096471    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096475    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096480    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096483    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096488    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096492    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.101345 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096496    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096500    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096505    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096509    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096513    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096517    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096521    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096525    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096530    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096534    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096538    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096542    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096546    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096552    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096557    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096561    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096565    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096569    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096573    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.101860 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096577    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096581    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096586    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096590    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096594    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096598    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096602    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096606    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096610    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096614    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096618    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096622    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096626    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096630    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096634    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096638    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096642    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096661    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096666    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096669    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.102349 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096674    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096678    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096683    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096687    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096694    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096698    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096704    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096708    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096712    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096716    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096720    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096724    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096728    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096732    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096736    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.096773    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:42:02.102874 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096829    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096836    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096841    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096846    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096852    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096856    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096860    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096864    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096867    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096871    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096875    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096879    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096884    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096888    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096893    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096897    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096901    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096905    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096910    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.103276 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096914    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096918    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096925    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096929    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096933    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096938    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096942    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096946    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096950    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096954    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096958    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096963    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096966    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096971    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096975    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096981    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096986    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096991    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.096996    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.103753 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097002    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097007    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097011    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097016    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097021    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097025    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097030    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097033    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097038    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097042    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097046    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097053    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097057    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097062    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097066    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097072    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097076    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097081    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097085    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.104208 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097090    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097094    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097099    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097103    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097108    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097113    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097117    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097121    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097125    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097129    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097133    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097138    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097142    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097146    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097151    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097156    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097160    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097164    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097168    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097172    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.104706 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097177    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097181    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097185    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097189    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097194    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097198    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097202    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097206    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097212    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097216    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097220    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097225    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097229    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097233    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097237    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097241    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097249    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097253    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097257    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097262    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.105182 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097288    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097293    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097297    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097302    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097305    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097309    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097314    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097318    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.097322    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.104973    2579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.104995    2579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.105012    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.105018    2579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105078    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105084    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105088    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105090    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105093    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105096    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.105686 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105100    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105105    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105108    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105111    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105113    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105116    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105118    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105121    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105124    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105127    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105129    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105132    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105135    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105138    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105140    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105143    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105145    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105148    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105151    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105154    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.106134 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105156    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105159    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105162    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105172    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105175    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105178    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105181    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105184    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105187    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105189    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105192    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105195    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105197    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105200    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105203    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105205    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105208    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105210    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105212    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105215    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.106678 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105217    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105220    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105222    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105225    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105227    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105230    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105233    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105235    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105238    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105240    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105243    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105246    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105248    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105251    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105253    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105256    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105264    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105267    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105270    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.107140 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105272    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105275    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105277    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105280    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105282    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105285    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105287    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105290    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105293    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105295    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105297    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105300    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105303    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105305    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105307    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105310    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105313    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105315    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105318    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105321    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.107592 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105324    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105326    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105329    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105332    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105334    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105336    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105339    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105341    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105345    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105349    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105358    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105361    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105364    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105367    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105369    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105372    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105374    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105377    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105379    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.108161 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105382    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105385    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.105424    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105628    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105633    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105636    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105639    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105641    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105644    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105658    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105661    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105664    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105667    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105670    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105673    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105675    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.108878 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105679    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105681    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105684    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105686    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105690    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105694    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105698    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105702    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105712    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105715    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105718    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105720    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105723    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105726    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105730    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105734    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105737    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105740    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105743    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.109492 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105745    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105748    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105751    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105754    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105757    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105759    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105762    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105764    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105767    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105769    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105772    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105775    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105778    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105781    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105783    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105786    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105788    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105791    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105793    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105796    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.109989 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105799    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105802    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105810    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105813    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105815    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105817    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105820    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105823    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105825    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105828    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105830    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105833    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105835    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105838    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105841    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105844    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105846    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105849    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105851    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.110775 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105854    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105856    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105859    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105863    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105867    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105870    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105873    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105875    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105878    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105892    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105895    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105898    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105900    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105903    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105905    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105908    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105916    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105919    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105922    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.111278 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105925    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105927    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105930    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105932    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105935    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105938    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105940    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105943    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105946    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105949    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105951    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105954    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105957    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105959    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105962    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.105964    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.111869 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.105989    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106028    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106032    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106035    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106038    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106041    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106043    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106046    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106048    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106051    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106053    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106056    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106059    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106061    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106069    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106073    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106075    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106077    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106080    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106083    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:42:02.112363 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106085    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106088    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106090    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106093    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106096    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106098    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106100    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106103    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106106    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106108    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106111    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106114    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106116    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106119    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106122    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106124    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106127    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106129    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106132    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106134    2579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:42:02.112851 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106137    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106140    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106142    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106145    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106147    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106150    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106152    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106160    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106164    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106168    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106171    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106173    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106176    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106178    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106181    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106184    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106186    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106189    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106191    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106194    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:42:02.113379 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106196    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106199    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106202    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106204    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106206    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106209    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106212    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106214    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106217    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106219    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106222    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106224    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106228    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106230    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106233    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106235    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106238    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106241    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106243    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:42:02.113888 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106246    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106254    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106257    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106259    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106262    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106264    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106267    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106269    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106272    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106274    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106277    2579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106280    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106282    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106285    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106287    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106290    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106294    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106297    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106300    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:42:02.114372 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106303    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106305    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106308    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106310    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106313    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106315    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106318    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106320    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:02.106323    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.106401    2579 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.111798    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.112972    2579 server.go:1014] "Starting client certificate rotation"
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.113076    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:42:02.114941 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.113115    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:42:02.115573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.115554    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:42:02.116834 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.116812    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:42:02.127976 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.127953    2579 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:42:02.130715 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.130699    2579 log.go:25] "Validated CRI v1 image API"
Oct 30 21:42:02.132328 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.132293    2579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:42:02.141581 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.141557    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cd0a692-1000-47c3-9a9f-261faf4404ca:/dev/nvme0n1p4 d3eae9bc-804a-4a80-a6f1-b3061cd642c9:/dev/nvme0n1p3]
Oct 30 21:42:02.141640 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.141580    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:42:02.146565 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.146447    2579 manager.go:217] Machine: {Timestamp:2026-10-30 21:42:02.14594902 +0000 UTC m=+0.402126894 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096220 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2119e139414e651f7a3d9916cf8641 SystemUUID:ec2119e1-3941-4e65-1f7a-3d9916cf8641 BootID:871ffe7f-1c82-4400-ad9a-96e5f83e420e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:c6:e5:df:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:c6:e5:df:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:bf:2a:4c:87:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:42:02.146565 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.146559    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:42:02.146699 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.146687    2579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:42:02.150699 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150667    2579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:42:02.150884 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150706    2579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-66.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:42:02.150933 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150890    2579 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:42:02.150933 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150902    2579 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:42:02.150933 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150924    2579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:42:02.151008 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.150944    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:42:02.152133 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.152120    2579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:42:02.156835 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.156819    2579 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:42:02.157000 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.156989    2579 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:42:02.158075 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158064    2579 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:42:02.158115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158081    2579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:42:02.158115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158096    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:42:02.158115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158108    2579 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:42:02.158209 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158119    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:42:02.158636 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.158623    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:42:02.162438 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.162400    2579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:42:02.169346 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.169329    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:42:02.170305 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170291    2579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:42:02.170355 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170323    2579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:42:02.170528 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170518    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:42:02.170558 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170534    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:42:02.170558 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170541    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:42:02.170558 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170550    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:42:02.170558 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170559    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:42:02.170672 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.170568    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:42:02.171198 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171187    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:42:02.171198 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171198    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:42:02.171250 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171206    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:42:02.171250 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171211    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:42:02.171250 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171221    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:42:02.171250 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.171230    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:42:02.172128 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.172117    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:42:02.172167 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.172131    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:42:02.176798 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.176784    2579 server.go:1263] "Started kubelet"
Oct 30 21:42:02.176942 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.176907    2579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:42:02.176984 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.176891    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:42:02.177017 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.176986    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:42:02.177735 ip-10-0-139-66 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:42:02.178291 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.178273    2579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:42:02.180223 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.180206    2579 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:42:02.183548 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.183528    2579 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:42:02.184588 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.184572    2579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:42:02.184676 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.184584    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:42:02.184736 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.184698    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:42:02.185433 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185198    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:42:02.185433 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185206    2579 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:42:02.185433 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185226    2579 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:42:02.185433 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185313    2579 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:42:02.185433 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185324    2579 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:42:02.185756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185738    2579 factory.go:55] Registering systemd factory
Oct 30 21:42:02.185756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.185758    2579 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:42:02.186053 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.186031    2579 factory.go:153] Registering CRI-O factory
Oct 30 21:42:02.186113 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.186057    2579 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:42:02.186172 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.186151    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:42:02.186208 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.186182    2579 factory.go:103] Registering Raw factory
Oct 30 21:42:02.186208 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.186199    2579 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:42:02.187320 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.187304    2579 manager.go:319] Starting recovery of all containers
Oct 30 21:42:02.198018 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.197995    2579 manager.go:324] Recovery completed
Oct 30 21:42:02.202112 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.202096    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.203924 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.203900    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.203992 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.203940    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.203992 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.203957    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.204556 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.204542    2579 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:42:02.204556 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.204555    2579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:42:02.204715 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.204571    2579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:42:02.204715 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.204548    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.205385 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.205368    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.205475 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.205401    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.205475 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.205423    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.206815 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.206802    2579 policy_none.go:50] "Start"
Oct 30 21:42:02.206815 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.206818    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:42:02.206907 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.206829    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:42:02.208814 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.208804    2579 policy_none.go:44] "Start"
Oct 30 21:42:02.258481 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.258439    2579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:42:02.261269 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261255    2579 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:42:02.261330 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.261291    2579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:42:02.261330 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261301    2579 server.go:87] "Starting device plugin registration server"
Oct 30 21:42:02.261667 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261628    2579 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:42:02.261965 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261643    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:42:02.261965 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261734    2579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:42:02.261965 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261824    2579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:42:02.261965 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.261833    2579 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:42:02.262409 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.262387    2579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:42:02.262493 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.262438    2579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:42:02.323253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.323217    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-66.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:42:02.323253 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.323225    2579 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-66.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:42:02.324849 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.323217    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-66.us-west-2.compute.internal.18e36ca295c43153  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-66.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-66.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 21:42:02.176754003 +0000 UTC m=+0.432931878,LastTimestamp:2026-10-30 21:42:02.176754003 +0000 UTC m=+0.432931878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-66.us-west-2.compute.internal,}"
Oct 30 21:42:02.326619 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.326587    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:42:02.327745 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.327725    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:42:02.327745 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.327747    2579 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:42:02.327900 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.327766    2579 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:42:02.327900 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.327797    2579 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:42:02.362145 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.362042    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.363282 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.363267    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.363351 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.363298    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.363351 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.363317    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.363351 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.363343    2579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.384456 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.384431    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:42:02.384511 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.384486    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whmx4"
Oct 30 21:42:02.428453 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.428274    2579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"]
Oct 30 21:42:02.428549 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.428497    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.429484 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.429453    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.429611 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.429491    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.429611 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.429506    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.431410 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.431389    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.431574 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.431559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.431634 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.431590    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.432258 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432235    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.432327 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432270    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.432327 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432283    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.432396 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432238    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.432396 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432357    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.432396 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.432368    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.434165 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.434148    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.434221 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.434186    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:42:02.434956 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.434941    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:42:02.435032 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.434968    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:42:02.435032 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.434977    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:42:02.463925 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.463901    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-66.us-west-2.compute.internal\" not found" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.467012 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:02.466992    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-66.us-west-2.compute.internal\" not found" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.480769 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.480747    2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:02.487443 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.487003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.487503 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.487461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.487503 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.487479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:02.570640 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:02.570612    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:03.590971 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.590955    2579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:03.591316 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.591300    2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:03.592051 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.592037    2579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.592093 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:03.592060    2579 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-66.us-west-2.compute.internal\": node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:42:03.606425 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.606501 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.606501 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.606501 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606473    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.606501 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606495    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.606619 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.606504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.703975 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.703920    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.771439 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.771408    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:42:03.771629 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.771557    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.786241 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.786216    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.789340 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.789317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:42:03.837819 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:03.837796    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:42:04.130775 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.130692    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:42:04.131297 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.130858    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:42:04.131297 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.130887    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:42:04.131297 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.130945    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:42:04.131297 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.130963    2579 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a004d3cd47af64f05b1402e813782859-9b2f76aefe485d1f.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-139-66.us-west-2.compute.internal.18e36ca297635902\": read tcp 10.0.139.66:44144->3.22.246.75:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-139-66.us-west-2.compute.internal.18e36ca297635902  default   5323 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-66.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-66.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-66.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 21:42:02 +0000 UTC,LastTimestamp:2026-10-30 21:42:02.363323229 +0000 UTC m=+0.619501104,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-66.us-west-2.compute.internal,}"
Oct 30 21:42:04.176564 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.176527    2579 apiserver.go:52] "Watching apiserver"
Oct 30 21:42:04.203033 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.202999    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:42:04.407761 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.407692    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:37:03 +0000 UTC" deadline="2028-07-22 01:47:04.683243204 +0000 UTC"
Oct 30 21:42:04.407761 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.407757    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15124h5m0.275489739s"
Oct 30 21:42:04.440109 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.440078    2579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:42:04.440440 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.440418    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp","openshift-multus/multus-f65sz","openshift-ovn-kubernetes/ovnkube-node-fp26p","kube-system/global-pull-secret-syncer-t84qg","kube-system/konnectivity-agent-xzx5c","openshift-cluster-node-tuning-operator/tuned-jnqlp","openshift-network-diagnostics/network-check-target-s8spg","openshift-network-operator/iptables-alerter-rpwqf","openshift-image-registry/node-ca-ptsl8","openshift-multus/multus-additional-cni-plugins-g8jl6","openshift-dns/node-resolver-gkkhd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal","openshift-multus/network-metrics-daemon-4cfvw","kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"]
Oct 30 21:42:04.442698 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.442676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.444696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.444680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.446742 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.446724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.448924 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.448909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.449007 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.448974    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:04.451287 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.451266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.453379 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.453361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.455456 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.455438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:04.455524 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.455499    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:04.457439 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.457425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.460126 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.460114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.462219 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.462198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.464262 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.464249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.466393 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.466374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.466496 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.466443    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:04.494843 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.494816    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:42:04.495026 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.494922    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qk7p\""
Oct 30 21:42:04.497604 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497583    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.497604 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497598    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.497756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497600    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:42:04.497756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497606    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hdwjf\""
Oct 30 21:42:04.497756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497667    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.497756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497727    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:42:04.497867 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.497811    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.501588 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.501572    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:42:04.501684 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.501648    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:42:04.501684 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.501669    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.501791 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.501678    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.502008 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.501992    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s2ds7\""
Oct 30 21:42:04.502049 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.502015    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:42:04.502049 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.502025    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:42:04.503317 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.503301    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:42:04.505154 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.505136    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:42:04.510173 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510274 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510274 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.510274 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510274 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585f6\" (UniqueName: \"kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9hc\" (UniqueName: \"kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqbh\" (UniqueName: \"kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5m2\" (UniqueName: \"kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.510778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.510993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntwg\" (UniqueName: \"kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.511374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm84s\" (UniqueName: \"kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.512202 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvf4\" (UniqueName: \"kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.512633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.511998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qd2\" (UniqueName: \"kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8s4b\" (UniqueName: \"kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.513077 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.512126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.541979 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.541956    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5r6kl\""
Oct 30 21:42:04.541979 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.541957    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:42:04.542100 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.542043    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58hb8\""
Oct 30 21:42:04.544809 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.544790    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.544809 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.544810    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.544994 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.544810    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.592713 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.592688    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:42:04.592833 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.592729    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8zf7"
Oct 30 21:42:04.595416 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595394    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.595518 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595453    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.595697 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595672    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:42:04.595697 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595684    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595706    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rx46t\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595697    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595705    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595747    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595786    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-48hj5\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595812    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wvvdp\""
Oct 30 21:42:04.595844 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595827    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:42:04.596065 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595884    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vwlkq\""
Oct 30 21:42:04.596065 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.595950    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:42:04.612501 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.612594 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm84s\" (UniqueName: \"kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.612594 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.612665 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612588    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.612665 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.612665 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.612665 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.612786 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612662    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.612786 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.612786 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.612786 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612688    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.612786 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612819    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.612903    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612908    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.613005    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:05.112960679 +0000 UTC m=+2.350857650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:04.613030 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.612905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613095    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613165    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613169    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613233    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613304    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613354 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613375    2579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvf4\" (UniqueName: \"kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613516    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613565    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613670    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613713    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613747    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613759    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.613836 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613911    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613913    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.613963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qd2\" (UniqueName: \"kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8s4b\" (UniqueName: \"kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614271    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.614696 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614390    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614397    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614482    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614565    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614600    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614645    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.615334 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.615048    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615867 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.614547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585f6\" (UniqueName: \"kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.615867 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.615491    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.615981 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.615909    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.616626 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.616194    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.616626 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.616330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.616819 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.616728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617048    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9hc\" (UniqueName: \"kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617424    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqbh\" (UniqueName: \"kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5m2\" (UniqueName: \"kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.618568 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617645    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617692    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617721    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617802    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.617845    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.619415 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.617913    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:05.117873314 +0000 UTC m=+2.355770296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617890    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.617992    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntwg\" (UniqueName: \"kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618040    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618204    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618243    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618280    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618296    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618599    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618647    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620177 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618770    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.618912    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619034    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619036    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619225    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619292    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.620906 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.619707    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.621482 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.621064    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.621482 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.621180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.621630 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.621610    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.622287 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.622265    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.673253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.673182    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm84s\" (UniqueName: \"kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.677122 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.677092    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvf4\" (UniqueName: \"kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.677263 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.677141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qd2\" (UniqueName: \"kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.678504 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.678480    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:04.678595 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.678508    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:04.678595 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.678525    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:04.678595 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:04.678587    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:05.178567376 +0000 UTC m=+2.416464350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:04.678809 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.678783    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-585f6\" (UniqueName: \"kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.679604 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.679578    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8s4b\" (UniqueName: \"kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:04.680493 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.680464    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqbh\" (UniqueName: \"kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.680493 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.680480    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntwg\" (UniqueName: \"kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.680600 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.680492    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5m2\" (UniqueName: \"kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.680630 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.680608    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9hc\" (UniqueName: \"kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.775582 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.775553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:42:04.779165 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.779136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f65sz"
Oct 30 21:42:04.809017 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.808991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:04.813823 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.813804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:04.831882 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.831860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:42:04.848615 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.848585    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:42:04.862212 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.862181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:42:04.885825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.885797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:42:04.890351 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.890334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:42:04.961016 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:04.960973    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc66296f1ac47a99ab1c1b04d380e57.slice/crio-2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268 WatchSource:0}: Error finding container 2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268: Status 404 returned error can't find the container with id 2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268
Oct 30 21:42:04.961441 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:04.961415    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e63feea4e10327df2e22d81d9a9cb4a.slice/crio-addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3 WatchSource:0}: Error finding container addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3: Status 404 returned error can't find the container with id addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3
Oct 30 21:42:04.967510 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:04.967488    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:42:05.123181 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.123147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:05.123340 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.123195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:05.123340 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.123290    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:05.123411 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.123355    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:06.123335442 +0000 UTC m=+3.361232399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:05.123411 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.123290    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:05.123411 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.123397    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:06.123386795 +0000 UTC m=+3.361283754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:05.224452 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.224371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:05.224986 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.224497    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:05.224986 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.224510    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:05.224986 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.224519    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:05.224986 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:05.224560    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:06.22454941 +0000 UTC m=+3.462446367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:05.258358 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.258332    2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:05.350461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.350410    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"4e63feea4e10327df2e22d81d9a9cb4a","Type":"ContainerStarted","Data":"addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3"}
Oct 30 21:42:05.351385 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.351363    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerStarted","Data":"2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268"}
Oct 30 21:42:05.595684 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.595582    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:37:04 +0000 UTC" deadline="2028-08-09 02:15:22.961754482 +0000 UTC"
Oct 30 21:42:05.595684 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.595627    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15556h33m17.366130982s"
Oct 30 21:42:05.658458 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.658430    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a76c87d_760c_46a0_a5ad_6544e28cf233.slice/crio-7b288a4562242113489394439431045a2d44362766990ce1b764ca4687a1017f WatchSource:0}: Error finding container 7b288a4562242113489394439431045a2d44362766990ce1b764ca4687a1017f: Status 404 returned error can't find the container with id 7b288a4562242113489394439431045a2d44362766990ce1b764ca4687a1017f
Oct 30 21:42:05.678650 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.678611    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf73114_c86c_4008_9ff5_59db6b792f59.slice/crio-80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221 WatchSource:0}: Error finding container 80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221: Status 404 returned error can't find the container with id 80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221
Oct 30 21:42:05.679063 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.679040    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5277871d_bce6_4ba0_b3f5_94bf076abb1f.slice/crio-260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147 WatchSource:0}: Error finding container 260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147: Status 404 returned error can't find the container with id 260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147
Oct 30 21:42:05.680654 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.680634    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:05.702657 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.702635    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51df616_11c7_429e_a475_aeb655678373.slice/crio-17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720 WatchSource:0}: Error finding container 17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720: Status 404 returned error can't find the container with id 17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720
Oct 30 21:42:05.727922 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.727898    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91da06b6_dab9_4b20_b18a_9f751e52f6ab.slice/crio-3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7 WatchSource:0}: Error finding container 3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7: Status 404 returned error can't find the container with id 3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7
Oct 30 21:42:05.728108 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:05.728091    2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:42:05.759113 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.759087    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b378c7_d792_4388_bc7c_44d06dc47bf0.slice/crio-4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d WatchSource:0}: Error finding container 4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d: Status 404 returned error can't find the container with id 4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d
Oct 30 21:42:05.759696 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.759673    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea1543f_520c_4e59_8cd8_3228d705eccb.slice/crio-669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b WatchSource:0}: Error finding container 669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b: Status 404 returned error can't find the container with id 669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b
Oct 30 21:42:05.789002 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.788976    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0875aed8_0caa_4fce_9b91_ec25b54c9767.slice/crio-1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6 WatchSource:0}: Error finding container 1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6: Status 404 returned error can't find the container with id 1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6
Oct 30 21:42:05.871407 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:05.871378    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a687a1a_42ac_4478_96d1_5f0aec1df5ff.slice/crio-51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e WatchSource:0}: Error finding container 51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e: Status 404 returned error can't find the container with id 51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e
Oct 30 21:42:06.130878 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.130790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:06.130878 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.130869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:06.131097 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.130987    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:06.131097 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.130999    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:06.131097 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.131064    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:08.131044423 +0000 UTC m=+5.368941383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:06.131097 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.131084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:08.131074626 +0000 UTC m=+5.368971585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:06.231407 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.231367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:06.232023 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.231574    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:06.232023 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.231595    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:06.232023 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.231606    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:06.232023 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.231650    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:08.2316366 +0000 UTC m=+5.469533571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:06.346699 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.346644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:06.346699 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.346659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:06.346955 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.346776    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:06.346955 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.346817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:06.346955 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.346891    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:06.347117 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:06.346984    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:06.354075 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.354049    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gkkhd" event={"ID":"91da06b6-dab9-4b20-b18a-9f751e52f6ab","Type":"ContainerStarted","Data":"3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7"}
Oct 30 21:42:06.355484 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.355460    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzx5c" event={"ID":"f51df616-11c7-429e-a475-aeb655678373","Type":"ContainerStarted","Data":"17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720"}
Oct 30 21:42:06.356801 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.356780    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpwqf" event={"ID":"0875aed8-0caa-4fce-9b91-ec25b54c9767","Type":"ContainerStarted","Data":"1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6"}
Oct 30 21:42:06.357999 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.357971    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f65sz" event={"ID":"aea1543f-520c-4e59-8cd8-3228d705eccb","Type":"ContainerStarted","Data":"669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b"}
Oct 30 21:42:06.359363 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.359339    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147"}
Oct 30 21:42:06.360673 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.360652    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp" event={"ID":"5cf73114-c86c-4008-9ff5-59db6b792f59","Type":"ContainerStarted","Data":"80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221"}
Oct 30 21:42:06.361991 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.361957    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnqlp" event={"ID":"6a76c87d-760c-46a0-a5ad-6544e28cf233","Type":"ContainerStarted","Data":"7b288a4562242113489394439431045a2d44362766990ce1b764ca4687a1017f"}
Oct 30 21:42:06.363212 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.363170    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerStarted","Data":"51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e"}
Oct 30 21:42:06.364557 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.364530    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ptsl8" event={"ID":"61b378c7-d792-4388-bc7c-44d06dc47bf0","Type":"ContainerStarted","Data":"4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d"}
Oct 30 21:42:06.596143 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.596086    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:37:04 +0000 UTC" deadline="2028-05-20 02:43:17.073702766 +0000 UTC"
Oct 30 21:42:06.596143 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:06.596139    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13613h1m10.477567148s"
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.154193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.154261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.154370    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.154417    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:12.154402724 +0000 UTC m=+9.392299681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.154480    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:08.154797 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.154503    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:12.154496266 +0000 UTC m=+9.392393224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:08.256074 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.255716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:08.256074 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.255876    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:08.256074 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.255899    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:08.256074 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.255912    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:08.256074 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.255996    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:12.255977548 +0000 UTC m=+9.493874525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:08.347270 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.347240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:08.347428 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.347340    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:08.347428 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.347387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:08.347428 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.347426    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:08.347596 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:08.347471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:08.347596 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:08.347514    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:09.397633 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:09.397375    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbc66296f1ac47a99ab1c1b04d380e57" containerID="1240fc7db068b3f75a47d57971cdc43879678c9908f92c0e1c630fbce4fb949f" exitCode=0
Oct 30 21:42:09.398129 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:09.397703    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerDied","Data":"1240fc7db068b3f75a47d57971cdc43879678c9908f92c0e1c630fbce4fb949f"}
Oct 30 21:42:09.405871 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:09.405833    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"4e63feea4e10327df2e22d81d9a9cb4a","Type":"ContainerStarted","Data":"e12c09e12c82aa4cf489b2d0c6805b895a1f89b0d6edcc65de466bdd4f08bffe"}
Oct 30 21:42:09.413618 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:09.413585    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerStarted","Data":"92de09ed08cf6d057812e8821699686aebc590808994e82f3d7ea63d46b29d8e"}
Oct 30 21:42:10.347133 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.347103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:10.347309 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:10.347226    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:10.347309 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.347297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:10.347439 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:10.347369    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:10.347439 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.347418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:10.347537 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:10.347495    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:10.421522 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.421486    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="92de09ed08cf6d057812e8821699686aebc590808994e82f3d7ea63d46b29d8e" exitCode=0
Oct 30 21:42:10.422006 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.421586    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"92de09ed08cf6d057812e8821699686aebc590808994e82f3d7ea63d46b29d8e"}
Oct 30 21:42:10.427682 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.427653    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzx5c" event={"ID":"f51df616-11c7-429e-a475-aeb655678373","Type":"ContainerStarted","Data":"402f970fff00c1809b6c1fefe46a16cc73d469ba100eba0e3818ae73728e9adf"}
Oct 30 21:42:10.432323 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.432300    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerStarted","Data":"b885580b807b67dd1fc3722ccf0b698e9205647bc502acda16f1e35a705a63f7"}
Oct 30 21:42:10.566848 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.566779    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal" podStartSLOduration=7.566757794 podStartE2EDuration="7.566757794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:09.775547163 +0000 UTC m=+7.013444143" watchObservedRunningTime="2026-10-30 21:42:10.566757794 +0000 UTC m=+7.804654775"
Oct 30 21:42:10.800205 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:10.800102    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" podStartSLOduration=7.800081481 podStartE2EDuration="7.800081481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:10.683436856 +0000 UTC m=+7.921333838" watchObservedRunningTime="2026-10-30 21:42:10.800081481 +0000 UTC m=+8.037978461"
Oct 30 21:42:12.191461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.191393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:12.191461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.191448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:12.191880 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.191566    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:12.191880 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.191613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:20.191600829 +0000 UTC m=+17.429497786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:12.191880 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.191666    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:12.191880 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.191697    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:20.191683541 +0000 UTC m=+17.429580499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:12.292688 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.292625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:12.292871 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.292828    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:12.292871 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.292850    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:12.292871 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.292863    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:12.293061 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.292923    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:20.292906762 +0000 UTC m=+17.530803723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:12.346925 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.346897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:12.347098 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.347036    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:12.347168 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.347100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:12.347168 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.347153    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:12.347273 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.347194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:12.347273 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:12.347242    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:12.440882 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.440808    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ptsl8" event={"ID":"61b378c7-d792-4388-bc7c-44d06dc47bf0","Type":"ContainerStarted","Data":"f426833ec2792fae5cf6015320e0c8288514c6b8a1341de9ee552902fb1917c0"}
Oct 30 21:42:12.443359 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.443296    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp" event={"ID":"5cf73114-c86c-4008-9ff5-59db6b792f59","Type":"ContainerStarted","Data":"667c3fa4c1dbb63e36ae01e150c6a3726a06e00ffd6f805eb451f48c85b3458d"}
Oct 30 21:42:12.560672 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:12.560618    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzx5c" podStartSLOduration=5.156211304 podStartE2EDuration="9.560600037s" totalImagesPullingTime="4.404388733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:10.801053798 +0000 UTC m=+8.038950778" watchObservedRunningTime="2026-10-30 21:42:12.560600037 +0000 UTC m=+9.798497013"
Oct 30 21:42:13.962273 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:13.962242    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:13.965314 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:13.965282    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:14.081948 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.081887    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ptsl8" podStartSLOduration=5.558156707 podStartE2EDuration="11.081871924s" totalImagesPullingTime="5.523715217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:12.561082492 +0000 UTC m=+9.798979472" watchObservedRunningTime="2026-10-30 21:42:14.081871924 +0000 UTC m=+11.319768912"
Oct 30 21:42:14.267307 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.267279    2579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:42:14.285914 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.285192    2579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:42:14.267302934Z","UUID":"c0178375-410b-4c63-a7d7-84ee47bcde7e","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:42:14.287462 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.287061    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:42:14.287462 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.287093    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:42:14.346922 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.346899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:14.347085 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:14.347048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:14.347145 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.347125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:14.347213 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:14.347195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:14.347264 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.347250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:14.347330 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:14.347313    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:14.452424 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.451791    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f65sz" event={"ID":"aea1543f-520c-4e59-8cd8-3228d705eccb","Type":"ContainerStarted","Data":"a14d240d3e66f19bcff5ef47d5de0b69f6c58a7de7a176da5de6f81fbd5632ef"}
Oct 30 21:42:14.454529 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.454502    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp" event={"ID":"5cf73114-c86c-4008-9ff5-59db6b792f59","Type":"ContainerStarted","Data":"4cc574d56b8e4bfdc13080bdbd27f05831098230ef7736e4806f63f792af27fb"}
Oct 30 21:42:14.456342 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.456317    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gkkhd" event={"ID":"91da06b6-dab9-4b20-b18a-9f751e52f6ab","Type":"ContainerStarted","Data":"8ede10fd99511c8ec92a660697fd15408eb154a67a29fc06a870f2798b21fac6"}
Oct 30 21:42:14.456667 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.456651    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:14.457075 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.457058    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:42:14.568200 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.568152    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-f65sz" podStartSLOduration=3.436645707 podStartE2EDuration="11.568135625s" totalImagesPullingTime="8.131489918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:14.567447242 +0000 UTC m=+11.805344223" watchObservedRunningTime="2026-10-30 21:42:14.568135625 +0000 UTC m=+11.806032605"
Oct 30 21:42:14.797266 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:14.797137    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-gkkhd" podStartSLOduration=3.337233045 podStartE2EDuration="11.797122855s" totalImagesPullingTime="8.45988981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:14.796628133 +0000 UTC m=+12.034525112" watchObservedRunningTime="2026-10-30 21:42:14.797122855 +0000 UTC m=+12.035019834"
Oct 30 21:42:15.461258 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:15.461010    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="c3996d96fd5d8af497543305efbabda936a4535f7929633089170599cb2248a2" exitCode=0
Oct 30 21:42:15.461258 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:15.461202    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"c3996d96fd5d8af497543305efbabda936a4535f7929633089170599cb2248a2"}
Oct 30 21:42:16.346686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.346652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:16.346686 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.346669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:16.346901 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.346666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:16.346901 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:16.346785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:16.346901 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:16.346817    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:16.346901 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:16.346868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:16.466124 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.466033    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp" event={"ID":"5cf73114-c86c-4008-9ff5-59db6b792f59","Type":"ContainerStarted","Data":"f568de1c768bb0e3440ba7966c637a2194f293c2da3fccef725624aec9ef51ea"}
Oct 30 21:42:16.468225 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.468199    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnqlp" event={"ID":"6a76c87d-760c-46a0-a5ad-6544e28cf233","Type":"ContainerStarted","Data":"44a579d5403559d1aaa8fd26d0b6633d7b27b6696596b148a601c9f61aa31d82"}
Oct 30 21:42:16.469944 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.469905    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpwqf" event={"ID":"0875aed8-0caa-4fce-9b91-ec25b54c9767","Type":"ContainerStarted","Data":"0d92c28846612a6b3e1a0b52bcc8d40bcaf1926ab30b3b973dc8797313e2d912"}
Oct 30 21:42:16.582015 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.581966    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp" podStartSLOduration=3.862785038 podStartE2EDuration="13.581947431s" totalImagesPullingTime="9.719162393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:16.581392232 +0000 UTC m=+13.819289212" watchObservedRunningTime="2026-10-30 21:42:16.581947431 +0000 UTC m=+13.819844412"
Oct 30 21:42:16.697442 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.697378    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rpwqf" podStartSLOduration=5.426100399 podStartE2EDuration="13.697362325s" totalImagesPullingTime="8.271261926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:16.69687196 +0000 UTC m=+13.934768940" watchObservedRunningTime="2026-10-30 21:42:16.697362325 +0000 UTC m=+13.935259305"
Oct 30 21:42:16.810988 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:16.810914    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jnqlp" podStartSLOduration=3.29537736 podStartE2EDuration="13.810893917s" totalImagesPullingTime="10.515516557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:16.810565898 +0000 UTC m=+14.048462877" watchObservedRunningTime="2026-10-30 21:42:16.810893917 +0000 UTC m=+14.048790897"
Oct 30 21:42:17.474785 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:17.474748    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="d3425078c8aed5639f0b8eb9fc504b144e39fe1d0979b5153a89233e40c158f9" exitCode=0
Oct 30 21:42:17.475378 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:17.474814    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"d3425078c8aed5639f0b8eb9fc504b144e39fe1d0979b5153a89233e40c158f9"}
Oct 30 21:42:18.346752 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:18.346712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:18.346913 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:18.346762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:18.346913 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:18.346869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:18.346913 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:18.346880    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:18.347110 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:18.347006    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:18.347110 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:18.347094    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:19.481964 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:19.481717    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="244494d6f332afb0e54245075f419170eb5419eb18c3cba03c3e0945c5e440b2" exitCode=0
Oct 30 21:42:19.481964 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:19.481874    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"244494d6f332afb0e54245075f419170eb5419eb18c3cba03c3e0945c5e440b2"}
Oct 30 21:42:20.257194 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.257157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:20.257273 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.257215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:20.257321 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.257311    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:20.257371 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.257314    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:20.257371 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.257363    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:36.257346746 +0000 UTC m=+33.495243713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:20.257476 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.257377    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:42:36.257371637 +0000 UTC m=+33.495268593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:20.346243 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.346217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:20.346335 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.346220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:20.346335 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.346315    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:20.346409 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.346388    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:20.346409 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.346220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:20.346464 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.346447    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:20.357589 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.357561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:20.357735 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.357682    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:20.357735 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.357696    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:20.357735 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.357706    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:20.357843 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:20.357748    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:42:36.357736691 +0000 UTC m=+33.595633652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:20.489361 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489323    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"b3b407d957e2180625cce60119a764a29be7dba43056d6e85c1dd0c00161540f"}
Oct 30 21:42:20.489764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489417    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"1796d216c9c68ae115721255c1d341fccd561c7da8b7110601353760972007c0"}
Oct 30 21:42:20.489764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489447    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"169f46576d008a879a01b6e20a3f948f9c47fe1be32623414edf507a3ed31a1b"}
Oct 30 21:42:20.489764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489474    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"e0c8f4b39212ae1ea03ceb6ac5765d1570c39957a808efb284fbdfde1cca902e"}
Oct 30 21:42:20.489764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489505    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"4ef3c190042a43eaa49db092fd39946443ac7e06049f2a8cc8fd0cbfe3a54867"}
Oct 30 21:42:20.489764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:20.489534    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"db443f6332d3428c63e58c2c5eb2a1dadb71060cf13c84b404aac8a3baf47e6c"}
Oct 30 21:42:22.347160 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:22.346964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:22.347646 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:22.346976    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:22.347646 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:22.347261    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:22.347646 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:22.346998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:22.347646 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:22.347299    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:22.347646 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:22.347378    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:22.496392 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:22.496364    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="8b33be5860bd91ff80658a166772d330aa890ce76ce403ac65f10c8ce97d5874" exitCode=0
Oct 30 21:42:22.496528 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:22.496399    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"8b33be5860bd91ff80658a166772d330aa890ce76ce403ac65f10c8ce97d5874"}
Oct 30 21:42:23.501226 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:23.501192    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="745d7ebd2a3466fab1cb82933b701ef624d53299e1f8529fee908ed474310bf5" exitCode=0
Oct 30 21:42:23.501762 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:23.501270    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerDied","Data":"745d7ebd2a3466fab1cb82933b701ef624d53299e1f8529fee908ed474310bf5"}
Oct 30 21:42:23.504509 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:23.504486    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"f6c62eeb1a5e391adb01d458973ef83be529574fb11f42880894f9ded60eda6a"}
Oct 30 21:42:24.347237 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:24.347207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:24.347427 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:24.347269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:24.347427 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:24.347359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:24.347427 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:24.347364    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:24.347554 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:24.347437    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:24.347554 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:24.347494    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:24.509584 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:24.509549    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" event={"ID":"2a687a1a-42ac-4478-96d1-5f0aec1df5ff","Type":"ContainerStarted","Data":"344a08f7df29c21750f13dd6369d4ea1eed759df13a42c42ff8570c3f95a9282"}
Oct 30 21:42:24.653293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:24.653246    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g8jl6" podStartSLOduration=9.496022563 podStartE2EDuration="21.653233789s" totalImagesPullingTime="12.157211226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:24.652206871 +0000 UTC m=+21.890103851" watchObservedRunningTime="2026-10-30 21:42:24.653233789 +0000 UTC m=+21.891130768"
Oct 30 21:42:25.517677 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:25.517634    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" event={"ID":"5277871d-bce6-4ba0-b3f5-94bf076abb1f","Type":"ContainerStarted","Data":"62b4fba32ba177bcc85344e06cadb33b26ee3153c2826301ce693f8d6df89ba0"}
Oct 30 21:42:25.785144 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:25.784853    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p" podStartSLOduration=8.35939916 podStartE2EDuration="22.784841223s" totalImagesPullingTime="14.425442063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:25.734889571 +0000 UTC m=+22.972786550" watchObservedRunningTime="2026-10-30 21:42:25.784841223 +0000 UTC m=+23.022738201"
Oct 30 21:42:26.346466 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.346429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:26.346843 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.346495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:26.346843 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.346580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:26.346843 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:26.346594    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:26.346843 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:26.346642    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:26.346843 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:26.346730    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:26.520231 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.520203    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:26.520681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.520270    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:26.520681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.520304    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:26.535795 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.535769    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:26.535981 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:26.535902    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:27.127765 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:27.127738    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gkkhd_91da06b6-dab9-4b20-b18a-9f751e52f6ab/dns-node-resolver/0.log"
Oct 30 21:42:27.716780 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:27.716756    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ptsl8_61b378c7-d792-4388-bc7c-44d06dc47bf0/node-ca/0.log"
Oct 30 21:42:28.346642 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:28.346610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:28.346813 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:28.346689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:28.346813 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:28.346794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:28.346908 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:28.346812    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:28.346908 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:28.346874    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:28.347062 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:28.346907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:30.346610 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:30.346580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:30.346610 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:30.346606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:30.347048 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:30.346616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:30.347048 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:30.346687    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:30.347048 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:30.346795    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:30.347048 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:30.346859    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:32.347178 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:32.347137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:32.347677 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:32.347141    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:32.347677 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:32.347246    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:32.347677 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:32.347335    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:32.347677 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:32.347142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:32.347677 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:32.347456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:34.347140 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:34.347105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:34.347592 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:34.347113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:34.347592 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:34.347218    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:34.347592 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:34.347319    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:34.347592 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:34.347105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:34.347592 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:34.347396    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:36.269231 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.269193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:36.269632 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.269250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:36.269632 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.269346    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:36.269632 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.269350    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:36.269632 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.269400    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs podName:22396b43-f6e0-48e7-8234-1ea6368f2584 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:08.269386372 +0000 UTC m=+65.507283330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs") pod "network-metrics-daemon-4cfvw" (UID: "22396b43-f6e0-48e7-8234-1ea6368f2584") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:42:36.269632 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.269413    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret podName:9b2aa126-a4b7-4494-8325-a0e5af72a287 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:08.269407184 +0000 UTC m=+65.507304141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret") pod "global-pull-secret-syncer-t84qg" (UID: "9b2aa126-a4b7-4494-8325-a0e5af72a287") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:42:36.347087 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.347056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:36.347087 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.347086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:36.347283 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.347163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:36.347283 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.347186    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:36.347283 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.347239    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:36.347371 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.347306    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:36.370238 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:36.370213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:36.370378 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.370364    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:42:36.370414 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.370382    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:42:36.370414 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.370392    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wcnvg for pod openshift-network-diagnostics/network-check-target-s8spg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:36.370479 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:36.370433    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg podName:132d08bc-26d2-4b7d-baa7-09acc3efad7f nodeName:}" failed. No retries permitted until 2026-10-30 21:43:08.370421399 +0000 UTC m=+65.608318361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wcnvg" (UniqueName: "kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg") pod "network-check-target-s8spg" (UID: "132d08bc-26d2-4b7d-baa7-09acc3efad7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:42:38.346339 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:38.346309    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:38.346339 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:38.346343    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:38.346756 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:38.346314    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:38.346756 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:38.346412    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:38.346756 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:38.346480    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:38.346756 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:38.346537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:40.346711 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:40.346674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:40.347134 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:40.346674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:40.347134 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:40.346780    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:40.347134 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:40.346876    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:40.347134 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:40.346674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:40.347134 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:40.347005    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:42.346694 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:42.346655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:42.346694 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:42.346683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:42.347267 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:42.346765    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:42.347267 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:42.346827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:42.347267 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:42.346963    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:42.347267 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:42.347034    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:44.346605 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.346572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:44.347049 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.346649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:44.347049 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.346774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:44.347049 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.346787    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:44.347049 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.346964    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:44.347049 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.347044    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:44.474068 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.474038    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4cfvw"]
Oct 30 21:42:44.474595 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.474573    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s8spg"]
Oct 30 21:42:44.475111 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.475086    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t84qg"]
Oct 30 21:42:44.556666 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.556643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:44.556847 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.556643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:44.556847 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.556744    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:44.557007 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:44.556649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:44.557007 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.556964    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:44.557007 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:44.556861    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:46.347008 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:46.346968    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:46.347440 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:46.346982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:46.347440 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:46.347091    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:46.347440 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:46.347181    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:46.347440 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:46.346982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:46.347440 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:46.347310    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:48.347113 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:48.346900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:48.347504 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:48.346900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:48.347504 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:48.347195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8spg" podUID="132d08bc-26d2-4b7d-baa7-09acc3efad7f"
Oct 30 21:42:48.347504 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:48.347252    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t84qg" podUID="9b2aa126-a4b7-4494-8325-a0e5af72a287"
Oct 30 21:42:48.347504 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:48.346900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:48.347504 ip-10-0-139-66 kubenswrapper[2579]: E1030 21:42:48.347361    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4cfvw" podUID="22396b43-f6e0-48e7-8234-1ea6368f2584"
Oct 30 21:42:48.994054 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:48.994022    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeReady"
Oct 30 21:42:48.994235 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:48.994165    2579 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:42:49.148882 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.148840    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dqh2j"]
Oct 30 21:42:49.164892 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.164865    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bnr7q"]
Oct 30 21:42:49.165066 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.165033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.172676 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.172653    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dm5lq"]
Oct 30 21:42:49.172819 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.172780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.181550 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.181530    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnr7q"]
Oct 30 21:42:49.181645 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.181561    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqh2j"]
Oct 30 21:42:49.181645 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.181634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.183898 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.183876    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm5lq"]
Oct 30 21:42:49.218970 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.218942    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:42:49.219316 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.219304    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j86j7\""
Oct 30 21:42:49.219399 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.219386    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:42:49.226389 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.226360    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:42:49.226389 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.226363    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:42:49.226607 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.226591    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:42:49.226655 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.226624    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-ssgdc\""
Oct 30 21:42:49.259426 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpwf6\" (UniqueName: \"kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.259426 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.259630 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.259630 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.259630 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.259758 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.259758 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.259758 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6w8\" (UniqueName: \"kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.259903 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.259903 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxklh\" (UniqueName: \"kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.259903 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.259895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.284970 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.284942    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:42:49.284970 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.284946    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:42:49.285126 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.284974    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:42:49.319588 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.319564    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jxkz7\""
Oct 30 21:42:49.319653 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.319632    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:42:49.360611 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.360611 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6w8\" (UniqueName: \"kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.360780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxklh\" (UniqueName: \"kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361077    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwf6\" (UniqueName: \"kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361161 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.361573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361363    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361383    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361443    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.361753 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.361740    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.364663 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.364639    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.364663 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.364655    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.364810 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.364669    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.417997 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.417963    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6w8\" (UniqueName: \"kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.418217 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.418196    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxklh\" (UniqueName: \"kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.418308 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.418292    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwf6\" (UniqueName: \"kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.494979 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.494924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:49.508624 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.508576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:42:49.519899 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.519828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:42:49.530366 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.530334    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:42:49.561100 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.561075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.592284 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.592254    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:42:49.614593 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.614560    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 21:42:49.614752 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.614601    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hd8j5\""
Oct 30 21:42:49.614752 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.614677    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 21:42:49.614912 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.614876    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 21:42:49.615304 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.615201    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 21:42:49.615304 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.615216    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 21:42:49.615304 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.615263    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 21:42:49.615304 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.615263    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 21:42:49.662617 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.662765 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.662765 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.662883 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.662883 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.663019 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.662997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.663084 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.663036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.763897 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.763852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.763897 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.763898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764163 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.763945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764163 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.763991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764163 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764163 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764163 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764401 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764352    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764753 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764753 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.764892 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.764845    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.766407 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.766388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.766461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.766449    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.824147 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.824082    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.885029 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.884994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:49.985483 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:49.985448    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm5lq"]
Oct 30 21:42:49.996826 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:49.996798    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3523d1_477a_444a_ab30_b46b32a844d1.slice/crio-0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440 WatchSource:0}: Error finding container 0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440: Status 404 returned error can't find the container with id 0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440
Oct 30 21:42:50.021957 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.021440    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnr7q"]
Oct 30 21:42:50.024117 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.024093    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqh2j"]
Oct 30 21:42:50.024843 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:50.024811    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b65435_0618_4ffe_9505_5be220342375.slice/crio-66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff WatchSource:0}: Error finding container 66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff: Status 404 returned error can't find the container with id 66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff
Oct 30 21:42:50.284518 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.284479    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:42:50.287641 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:50.287616    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159a51e4_6c79_42ff_ae2c_220f5e3046b0.slice/crio-631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f WatchSource:0}: Error finding container 631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f: Status 404 returned error can't find the container with id 631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f
Oct 30 21:42:50.346395 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.346366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:42:50.346554 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.346425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:42:50.346554 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.346515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:42:50.399042 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399012    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399086    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8c5b8\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399141    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399161    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6s2r8\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399203    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399283    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:42:50.399404 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.399332    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmtv9\""
Oct 30 21:42:50.571135 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.571098    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqh2j" event={"ID":"293c35ac-425f-47eb-b907-31c479810a75","Type":"ContainerStarted","Data":"b793d58bc1b5b9840014737525036e240e1a04012dec336a0b505646f7b14e00"}
Oct 30 21:42:50.575816 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.575785    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96cc8c648-h9rxd" event={"ID":"159a51e4-6c79-42ff-ae2c-220f5e3046b0","Type":"ContainerStarted","Data":"631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f"}
Oct 30 21:42:50.577205 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.577181    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm5lq" event={"ID":"4d3523d1-477a-444a-ab30-b46b32a844d1","Type":"ContainerStarted","Data":"680f39e9389d0ae64b69a348ef196ac1decd701595bc940cbf48beadfd2aab10"}
Oct 30 21:42:50.577309 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.577234    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm5lq" event={"ID":"4d3523d1-477a-444a-ab30-b46b32a844d1","Type":"ContainerStarted","Data":"0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440"}
Oct 30 21:42:50.578256 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:50.578237    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnr7q" event={"ID":"f0b65435-0618-4ffe-9505-5be220342375","Type":"ContainerStarted","Data":"66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff"}
Oct 30 21:42:52.588481 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.588443    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm5lq" event={"ID":"4d3523d1-477a-444a-ab30-b46b32a844d1","Type":"ContainerStarted","Data":"11240ad6d7f23c3f0bf510422e952e273a182d3c98d530c042ff0148cff2e367"}
Oct 30 21:42:52.717027 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.716976    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"]
Oct 30 21:42:52.729278 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.727954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.778764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.778697    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"]
Oct 30 21:42:52.827946 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.827905    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lcbz6\""
Oct 30 21:42:52.828155 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.827961    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:42:52.828155 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.827979    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:42:52.828155 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.828077    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 21:42:52.832988 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.832960    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:42:52.833156 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.833138    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:42:52.879709 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.879661    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"]
Oct 30 21:42:52.888008 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.887956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.888008 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.888003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.888288 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.888053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.888288 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.888159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgdx\" (UniqueName: \"kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.896342 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.895137    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p5j5z"]
Oct 30 21:42:52.896342 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.895264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.909374 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.909345    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"]
Oct 30 21:42:52.909518 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.909480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.989514 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.989681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.989681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.989681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.989681 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgdx\" (UniqueName: \"kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9js5w\" (UniqueName: \"kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v62q\" (UniqueName: \"kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.989880 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.989989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990183 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990521 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:52.990577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.990521    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.992387 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.992358    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.992548 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.992529    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:52.998085 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998059    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:42:52.998216 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998168    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:42:52.998289 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998276    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 21:42:52.998385 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998372    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-blx25\""
Oct 30 21:42:52.998485 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998473    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 21:42:52.998554 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998542    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:42:52.998761 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998638    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:42:52.998761 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:52.998704    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hv9kv\""
Oct 30 21:42:53.060451 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.060378    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgdx\" (UniqueName: \"kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:53.090850 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.090809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091037 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.090856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091037 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.090950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9js5w\" (UniqueName: \"kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091037 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.090987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v62q\" (UniqueName: \"kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091037 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.091253 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091641 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.091641 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.091319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.092079 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092049    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.092360 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092332    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.092448 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092429    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.092640 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.092709 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092692    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.092764 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092704    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.092852 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.092835    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.093461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.093349    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.093461 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.093409    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.094017 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.093697    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.094017 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.093953    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.094181 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.094088    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.095470 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.095447    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.098363 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.098341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:42:53.149356 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.149322    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9js5w\" (UniqueName: \"kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.149825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.149797    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v62q\" (UniqueName: \"kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.249279 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.249245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:42:53.300729 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.300704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:42:53.332621 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:53.330179    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fda3c0_2859_4e43_a320_fe86dfa0150b.slice/crio-3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b WatchSource:0}: Error finding container 3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b: Status 404 returned error can't find the container with id 3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b
Oct 30 21:42:53.594246 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.594103    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqh2j" event={"ID":"293c35ac-425f-47eb-b907-31c479810a75","Type":"ContainerStarted","Data":"3529c0435013cf07fe64a948cfd27b466af47d7f6273c20204e1d351133f8e45"}
Oct 30 21:42:53.594246 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.594176    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqh2j" event={"ID":"293c35ac-425f-47eb-b907-31c479810a75","Type":"ContainerStarted","Data":"a459ca4093c72e15da8ba11aaefadba80978f38f3a5a03f5f7d281189704c3f2"}
Oct 30 21:42:53.594994 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.594973    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:42:53.596753 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.596692    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5j5z" event={"ID":"34fda3c0-2859-4e43-a320-fe86dfa0150b","Type":"ContainerStarted","Data":"3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b"}
Oct 30 21:42:53.608648 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.608619    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"]
Oct 30 21:42:53.653258 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:53.653143    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01628e3_8e21_4385_a716_62fbc9adc347.slice/crio-1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb WatchSource:0}: Error finding container 1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb: Status 404 returned error can't find the container with id 1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb
Oct 30 21:42:53.663208 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.663179    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"]
Oct 30 21:42:53.668965 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:53.668938    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552df7e5_21a9_499c_854d_f14654c5e442.slice/crio-50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26 WatchSource:0}: Error finding container 50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26: Status 404 returned error can't find the container with id 50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26
Oct 30 21:42:53.711770 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:53.711717    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-dqh2j" podStartSLOduration=1.568673349 podStartE2EDuration="4.71169761s" totalImagesPullingTime="3.143024261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:53.710582855 +0000 UTC m=+50.948479836" watchObservedRunningTime="2026-10-30 21:42:53.71169761 +0000 UTC m=+50.949594591"
Oct 30 21:42:54.602516 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:54.602484    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd" event={"ID":"c01628e3-8e21-4385-a716-62fbc9adc347","Type":"ContainerStarted","Data":"8d1e77bef4f15637b9566af7c905a484732a17a8176b6c2f341a68ec0d470050"}
Oct 30 21:42:54.602969 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:54.602549    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd" event={"ID":"c01628e3-8e21-4385-a716-62fbc9adc347","Type":"ContainerStarted","Data":"35d876f9e2134d8f18ca726909320cecb6f5b13a619e6ecac4e3a1ab50455d0a"}
Oct 30 21:42:54.602969 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:54.602577    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd" event={"ID":"c01628e3-8e21-4385-a716-62fbc9adc347","Type":"ContainerStarted","Data":"1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb"}
Oct 30 21:42:54.604379 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:54.604347    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm" event={"ID":"552df7e5-21a9-499c-854d-f14654c5e442","Type":"ContainerStarted","Data":"50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26"}
Oct 30 21:42:55.610502 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.610418    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96cc8c648-h9rxd" event={"ID":"159a51e4-6c79-42ff-ae2c-220f5e3046b0","Type":"ContainerStarted","Data":"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"}
Oct 30 21:42:55.613044 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.613008    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm5lq" event={"ID":"4d3523d1-477a-444a-ab30-b46b32a844d1","Type":"ContainerStarted","Data":"f7e1156e3481715b4a73aec5affd09a034c88d415fb67cb086f0deddc796b377"}
Oct 30 21:42:55.614573 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.614549    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnr7q" event={"ID":"f0b65435-0618-4ffe-9505-5be220342375","Type":"ContainerStarted","Data":"32f21e69b070f6c9f386df3444eeb0346f59ccda5be7c7d6d036222175d1c735"}
Oct 30 21:42:55.729155 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.729085    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-96cc8c648-h9rxd" podStartSLOduration=1.871787212 podStartE2EDuration="6.729070526s" totalImagesPullingTime="4.857283314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:55.728628635 +0000 UTC m=+52.966525614" watchObservedRunningTime="2026-10-30 21:42:55.729070526 +0000 UTC m=+52.966967564"
Oct 30 21:42:55.850872 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.850804    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dm5lq" podStartSLOduration=1.932664147 podStartE2EDuration="6.850790335s" totalImagesPullingTime="4.918126188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:55.850264306 +0000 UTC m=+53.088161287" watchObservedRunningTime="2026-10-30 21:42:55.850790335 +0000 UTC m=+53.088687316"
Oct 30 21:42:55.967158 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:55.967094    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bnr7q" podStartSLOduration=2.462156343 podStartE2EDuration="6.967075635s" totalImagesPullingTime="4.504919292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:55.965539571 +0000 UTC m=+53.203436549" watchObservedRunningTime="2026-10-30 21:42:55.967075635 +0000 UTC m=+53.204972615"
Oct 30 21:42:56.620399 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:56.620368    2579 generic.go:356] "Generic (PLEG): container finished" podID="34fda3c0-2859-4e43-a320-fe86dfa0150b" containerID="e6b357b76054650fbb211f95b02209ccfc4e2ad0775c0aba5cddad0f2abde3d9" exitCode=0
Oct 30 21:42:56.620722 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:56.620439    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5j5z" event={"ID":"34fda3c0-2859-4e43-a320-fe86dfa0150b","Type":"ContainerDied","Data":"e6b357b76054650fbb211f95b02209ccfc4e2ad0775c0aba5cddad0f2abde3d9"}
Oct 30 21:42:56.623372 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:56.623343    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm" event={"ID":"552df7e5-21a9-499c-854d-f14654c5e442","Type":"ContainerStarted","Data":"9ce4dd2a8ae55606f16ebdf24e908cd3d66145988dd86278eda68776658e26c6"}
Oct 30 21:42:57.628769 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.628731    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd" event={"ID":"c01628e3-8e21-4385-a716-62fbc9adc347","Type":"ContainerStarted","Data":"36ec28e45263f2c011c1295125924d2c88b1c075960dc7dd0687346ea2953b38"}
Oct 30 21:42:57.630918 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.630893    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5j5z" event={"ID":"34fda3c0-2859-4e43-a320-fe86dfa0150b","Type":"ContainerStarted","Data":"e80a1a7cb2c5c2a454db64a89a5b08e48e0410d76675d66b1837c8539a77fc95"}
Oct 30 21:42:57.631050 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.630964    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p5j5z" event={"ID":"34fda3c0-2859-4e43-a320-fe86dfa0150b","Type":"ContainerStarted","Data":"bb02107f613f2b70877ae4fb89ba787d2d4fe759c95ded4742448953b02c8e88"}
Oct 30 21:42:57.632882 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.632861    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm" event={"ID":"552df7e5-21a9-499c-854d-f14654c5e442","Type":"ContainerStarted","Data":"f174a822bcf90001b3c79747119f66a7a079fbec64ed100dc4a0a4b7055aa93c"}
Oct 30 21:42:57.633003 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.632904    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm" event={"ID":"552df7e5-21a9-499c-854d-f14654c5e442","Type":"ContainerStarted","Data":"a175c9f12ff15b6b9ad6e3239a7561b2a04a699c396d992c16196e8f825e2eba"}
Oct 30 21:42:57.687530 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.685630    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b5c75f669-74m79"]
Oct 30 21:42:57.689035 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.689006    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.741327 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741298    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:42:57.741578 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741561    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 21:42:57.741642 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741599    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 21:42:57.741785 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741772    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2p7rl\""
Oct 30 21:42:57.741825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741773    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 21:42:57.741825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.741789    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3vt23c124vbse\""
Oct 30 21:42:57.747952 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.747908    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b5c75f669-74m79"]
Oct 30 21:42:57.752317 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.752268    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd" podStartSLOduration=2.8316277640000003 podStartE2EDuration="5.752250475s" totalImagesPullingTime="2.920622711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:57.751349351 +0000 UTC m=+54.989246330" watchObservedRunningTime="2026-10-30 21:42:57.752250475 +0000 UTC m=+54.990147458"
Oct 30 21:42:57.830737 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.830907 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.830907 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.830907 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.831079 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.831079 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.830942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.831079 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.831016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkgcw\" (UniqueName: \"kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.869072 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.869015    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p5j5z" podStartSLOduration=3.448303504 podStartE2EDuration="5.86900338s" totalImagesPullingTime="2.328371925s" totalInitContainerRuntime="92.327951ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:57.868729189 +0000 UTC m=+55.106626167" watchObservedRunningTime="2026-10-30 21:42:57.86900338 +0000 UTC m=+55.106900359"
Oct 30 21:42:57.931825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.931825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932101 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgcw\" (UniqueName: \"kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932101 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932101 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932101 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.931970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932101 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.932000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932435 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.932415    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932778 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.932752    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.932994 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.932977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.934457 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.934431    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.934922 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.934897    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.935018 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.934948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.990169 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.990135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgcw\" (UniqueName: \"kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:57.990691 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.990653    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm" podStartSLOduration=3.165294166 podStartE2EDuration="5.990641854s" totalImagesPullingTime="2.825347688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:57.989432263 +0000 UTC m=+55.227329244" watchObservedRunningTime="2026-10-30 21:42:57.990641854 +0000 UTC m=+55.228538834"
Oct 30 21:42:57.999816 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:57.999784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:42:58.420687 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:58.420652    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b5c75f669-74m79"]
Oct 30 21:42:58.424324 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:42:58.424297    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcf5bdf_5cf2_406e_8b17_796aa4178e88.slice/crio-2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63 WatchSource:0}: Error finding container 2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63: Status 404 returned error can't find the container with id 2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63
Oct 30 21:42:58.534773 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:58.534745    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:42:58.641102 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:58.641055    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79" event={"ID":"9bcf5bdf-5cf2-406e-8b17-796aa4178e88","Type":"ContainerStarted","Data":"2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63"}
Oct 30 21:42:59.887825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:59.887100    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:59.887825 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:59.887165    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:42:59.893282 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:42:59.893059    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:00.649043 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:00.649011    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79" event={"ID":"9bcf5bdf-5cf2-406e-8b17-796aa4178e88","Type":"ContainerStarted","Data":"7e39efd337ccb6e3e94fc79cae99e58744c60134a10d2cbc5e5cef6304deedc2"}
Oct 30 21:43:00.653367 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:00.653343    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:00.763702 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:00.763638    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79" podStartSLOduration=1.810298719 podStartE2EDuration="3.763625663s" totalImagesPullingTime="1.953326944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:00.762562783 +0000 UTC m=+58.000459763" watchObservedRunningTime="2026-10-30 21:43:00.763625663 +0000 UTC m=+58.001522642"
Oct 30 21:43:01.375644 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.375611    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:43:01.377773 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.377753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.530235 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.530195    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 21:43:01.531441 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.531419    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:43:01.561195 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561195 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561343 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561343 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561425 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561458 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561488 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.561546 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.561530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.662910 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.662879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.662946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.662962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.662983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.662997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663093 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663438 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663409    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663710 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663690    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663850 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.663970 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.663856    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.664162 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.664142    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.665560 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.665534    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.665667 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.665633    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.720044 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.720009    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:01.987993 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:01.987883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:02.355434 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:02.355347    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:43:02.388040 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:43:02.388012    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedf6695_2b79_47e4_b8f7_ce9ffaa24067.slice/crio-9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73 WatchSource:0}: Error finding container 9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73: Status 404 returned error can't find the container with id 9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73
Oct 30 21:43:02.657082 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:02.657049    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76844b94c8-lpxn9" event={"ID":"aedf6695-2b79-47e4-b8f7-ce9ffaa24067","Type":"ContainerStarted","Data":"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"}
Oct 30 21:43:02.657241 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:02.657102    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76844b94c8-lpxn9" event={"ID":"aedf6695-2b79-47e4-b8f7-ce9ffaa24067","Type":"ContainerStarted","Data":"9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73"}
Oct 30 21:43:02.775066 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:02.775014    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-76844b94c8-lpxn9" podStartSLOduration=1.774992914 podStartE2EDuration="1.774992914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:02.774135118 +0000 UTC m=+60.012032098" watchObservedRunningTime="2026-10-30 21:43:02.774992914 +0000 UTC m=+60.012889947"
Oct 30 21:43:03.329505 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.329467    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:03.333068 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.333045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.390427 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390389    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:43:03.390427 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390389    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:43:03.390427 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390415    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:43:03.391014 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390480    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0p0f59amjb8k\""
Oct 30 21:43:03.391014 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390484    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:43:03.391014 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390575    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:43:03.391014 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.390711    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-br247\""
Oct 30 21:43:03.479796 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.479763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.479796 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.479803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480059 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.479824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480059 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.479843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480059 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480059 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480196 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480196 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480196 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480295 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480196    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480295 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480295 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480295 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480295 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480452 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480452 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480452 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480452 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480578 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.480578 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.480502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.490902 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.490872    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:43:03.491100 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.491079    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:43:03.492516 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.492498    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:03.495371 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495351    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:43:03.495527 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495494    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:43:03.495527 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495519    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:43:03.495527 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495529    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:43:03.495722 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495597    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:43:03.495722 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.495640    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:43:03.541116 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.541090    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:43:03.581901 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.581789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.581901 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.581851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582115 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582299 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.582577 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.582577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583100 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583071    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583195 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583170    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583977 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583255    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583977 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583977 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583679    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.583977 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.583781    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.584338 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.584315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.584848 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.584822    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.585327 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.585018    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.585327 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.585140    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.585484 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.585412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.586714 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.586562    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.587109 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.587026    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.587211 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.587191    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.587434 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.587409    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.587739 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.587706    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.587833 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.587808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.588040 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.588021    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.588652 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.588635    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.640457 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.640424    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:03.651304 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:03.651273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:04.079816 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:04.079782    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:04.082561 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:43:04.082537    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc07ccf9_72d3_46b6_9533_35b39dbf3d62.slice/crio-b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f WatchSource:0}: Error finding container b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f: Status 404 returned error can't find the container with id b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f
Oct 30 21:43:04.617147 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:04.617118    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:04.665013 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:04.664985    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f"}
Oct 30 21:43:05.670071 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:05.670040    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed" exitCode=0
Oct 30 21:43:05.670438 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:05.670089    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"}
Oct 30 21:43:08.324375 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.324334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:08.324866 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.324483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:08.376228 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.376194    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:43:08.388088 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.388054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:08.425035 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.424982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:08.426165 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.426135    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:43:08.437910 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.437878    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:08.463951 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.463910    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6s2r8\""
Oct 30 21:43:08.473117 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.473072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:08.477430 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.477399    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:43:08.544045 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.543991    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:43:08.551972 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.551879    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:08.722717 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.722680    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8c5b8\""
Oct 30 21:43:08.731259 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.731224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:08.736805 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.736780    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmtv9\""
Oct 30 21:43:08.745037 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.745004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:08.859171 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:43:08.859139    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22396b43_f6e0_48e7_8234_1ea6368f2584.slice/crio-29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a WatchSource:0}: Error finding container 29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a: Status 404 returned error can't find the container with id 29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a
Oct 30 21:43:08.909919 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:08.909879    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4cfvw"]
Oct 30 21:43:09.108737 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.108662    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t84qg"]
Oct 30 21:43:09.111912 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:43:09.111884    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2aa126_a4b7_4494_8325_a0e5af72a287.slice/crio-9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2 WatchSource:0}: Error finding container 9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2: Status 404 returned error can't find the container with id 9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2
Oct 30 21:43:09.131366 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.131338    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s8spg"]
Oct 30 21:43:09.134648 ip-10-0-139-66 kubenswrapper[2579]: W1030 21:43:09.134622    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132d08bc_26d2_4b7d_baa7_09acc3efad7f.slice/crio-43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c WatchSource:0}: Error finding container 43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c: Status 404 returned error can't find the container with id 43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c
Oct 30 21:43:09.684911 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.684878    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s8spg" event={"ID":"132d08bc-26d2-4b7d-baa7-09acc3efad7f","Type":"ContainerStarted","Data":"43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c"}
Oct 30 21:43:09.685987 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.685958    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t84qg" event={"ID":"9b2aa126-a4b7-4494-8325-a0e5af72a287","Type":"ContainerStarted","Data":"9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2"}
Oct 30 21:43:09.686976 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.686951    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4cfvw" event={"ID":"22396b43-f6e0-48e7-8234-1ea6368f2584","Type":"ContainerStarted","Data":"29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a"}
Oct 30 21:43:09.689083 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.689063    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"}
Oct 30 21:43:09.689169 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:09.689113    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"}
Oct 30 21:43:10.696316 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:10.696272    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4cfvw" event={"ID":"22396b43-f6e0-48e7-8234-1ea6368f2584","Type":"ContainerStarted","Data":"6238c55f1f49b5a6442fbd0592a2b11a41719fabca7050a28415d8ebf6c7d900"}
Oct 30 21:43:10.696793 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:10.696335    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4cfvw" event={"ID":"22396b43-f6e0-48e7-8234-1ea6368f2584","Type":"ContainerStarted","Data":"5d34f44fce09342904013eb2c6989b6616fa46b585ca6c624c8658491326bec4"}
Oct 30 21:43:10.820413 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:10.820350    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4cfvw" podStartSLOduration=66.311513362 podStartE2EDuration="1m7.820329193s" totalImagesPullingTime="1.508815831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:10.818768771 +0000 UTC m=+68.056665750" watchObservedRunningTime="2026-10-30 21:43:10.820329193 +0000 UTC m=+68.058226172"
Oct 30 21:43:11.990228 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:11.988577    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:11.990727 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:11.990243    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:11.996137 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:11.996112    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:12.710945 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.710886    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"}
Oct 30 21:43:12.711118 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.710977    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"}
Oct 30 21:43:12.711118 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.711019    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"}
Oct 30 21:43:12.711118 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.711053    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerStarted","Data":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"}
Oct 30 21:43:12.716144 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.716118    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:12.858293 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:12.858188    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8714639549999998 podStartE2EDuration="9.858168138s" totalImagesPullingTime="7.970743657s" totalInitContainerRuntime="15.960526ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:12.855737056 +0000 UTC m=+70.093634036" watchObservedRunningTime="2026-10-30 21:43:12.858168138 +0000 UTC m=+70.096065119"
Oct 30 21:43:13.022904 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:13.022865    2579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:43:13.651683 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:13.651639    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:13.718908 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:13.718814    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s8spg" event={"ID":"132d08bc-26d2-4b7d-baa7-09acc3efad7f","Type":"ContainerStarted","Data":"b369da9993cd390c7c7f671d999a0340ed2ef47eee101a615f29000cd276d964"}
Oct 30 21:43:13.719742 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:13.719718    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:13.837469 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:13.837409    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s8spg" podStartSLOduration=66.526190608 podStartE2EDuration="1m10.837389834s" totalImagesPullingTime="4.311199226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:13.835341478 +0000 UTC m=+71.073238457" watchObservedRunningTime="2026-10-30 21:43:13.837389834 +0000 UTC m=+71.075286812"
Oct 30 21:43:14.962866 ip-10-0-139-66 kubenswrapper[2579]: I1030 21:43:14.962729    2579 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:14.962887 ip-10-0-139-66 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:43:14.987350 ip-10-0-139-66 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:43:14.987524 ip-10-0-139-66 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:43:14.987574 ip-10-0-139-66 systemd[1]: kubelet.service: Consumed 4.258s CPU time.
Oct 30 21:43:14.998555 ip-10-0-139-66 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:43:15.061152 ip-10-0-139-66 kubenswrapper[5579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:15.061152 ip-10-0-139-66 kubenswrapper[5579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:43:15.061152 ip-10-0-139-66 kubenswrapper[5579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:15.061152 ip-10-0-139-66 kubenswrapper[5579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:15.063213 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063127    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.063213 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063210    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.063213 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063214    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.063213 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063218    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063222    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063225    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063227    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063230    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063233    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063237    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063240    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063243    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063245    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063249    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063251    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063254    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063257    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063259    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063263    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063265    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063268    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063277    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.063372 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063282    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063287    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063290    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063293    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063296    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063299    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063301    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063304    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063306    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063310    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063312    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063315    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063318    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063320    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063323    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063325    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063328    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063331    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063333    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.063856 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063336    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063338    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063341    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063343    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063346    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063348    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063351    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063353    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063356    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063359    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063361    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063363    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063368    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063372    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063376    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063379    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063382    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063386    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063389    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.064340 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063392    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063394    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063397    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063399    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063402    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063405    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063407    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063410    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063412    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063416    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063418    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063421    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063423    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063426    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063429    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063431    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063434    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063437    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063440    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063443    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.064811 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063446    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063448    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063451    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063454    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063457    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063459    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063462    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063464    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063467    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063470    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063473    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063476    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063478    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063481    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063483    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063486    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063488    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063491    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063493    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063496    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.065325 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063499    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063501    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063504    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063507    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063513    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.063516    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064282    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064288    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064291    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064294    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064297    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064300    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064303    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064306    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064309    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064311    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064314    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064316    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064319    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064322    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.065857 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064325    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064328    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064331    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064334    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064336    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064339    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064342    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064344    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064347    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064350    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064352    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064355    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064357    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064360    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064362    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064365    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064370    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064373    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064375    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.066382 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064378    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064380    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064384    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064388    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064392    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064394    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064397    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064400    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064403    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064405    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064408    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064411    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064414    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064416    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064419    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064423    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064426    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064428    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064431    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.066848 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064433    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064436    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064439    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064441    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064444    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064446    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064449    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064451    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064454    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064456    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064462    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064467    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064470    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064473    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064476    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064478    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064481    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064484    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064486    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.067365 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064489    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064492    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064494    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064497    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064499    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064502    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064505    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064508    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064511    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064513    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064516    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064519    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064521    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064524    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064527    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064529    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064532    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064535    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064537    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.067872 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064540    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064543    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064545    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064548    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064552    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064554    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064558    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064560    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064563    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064565    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064568    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064571    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064573    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064576    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064579    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.064581    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065365    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065371    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065374    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065377    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065380    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.068357 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065383    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065386    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065389    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065391    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065394    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065397    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065399    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065402    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065405    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065409    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065413    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065416    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065419    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065422    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065425    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065430    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065433    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065436    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065438    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065441    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.068882 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065443    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065446    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065448    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065451    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065453    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065456    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065459    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065461    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065464    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065467    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065469    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065472    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065474    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065477    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065487    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065490    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065493    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065495    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065498    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.069389 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065501    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065503    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065506    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065508    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065511    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065513    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065515    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065518    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065522    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065525    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065527    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065530    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065532    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065536    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065538    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065541    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065543    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065546    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065548    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065551    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.070103 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065553    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065556    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065559    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065561    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065564    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065566    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065569    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065571    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065574    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065577    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065580    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065582    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065584    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065587    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065590    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065592    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065595    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065597    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065599    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.070913 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065602    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065607    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065609    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065612    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065616    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065619    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065621    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065624    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065626    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065629    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065631    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065634    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065636    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065640    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065644    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065647    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065650    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065653    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065655    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.071410 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065659    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065661    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065664    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.065666    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065763    5579 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065774    5579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065781    5579 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065785    5579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065790    5579 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065793    5579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065798    5579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065802    5579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065805    5579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065808    5579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065813    5579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065817    5579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065820    5579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065825    5579 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065827    5579 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065831    5579 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065834    5579 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065837    5579 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065840    5579 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065843    5579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:43:15.071878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065846    5579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065849    5579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065853    5579 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065857    5579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065860    5579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065863    5579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065867    5579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065870    5579 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065873    5579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065876    5579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065879    5579 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065882    5579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065887    5579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065891    5579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065894    5579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065896    5579 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065900    5579 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065903    5579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065907    5579 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065910    5579 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065914    5579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065917    5579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065921    5579 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065939    5579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:43:15.072488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065943    5579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065948    5579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065951    5579 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065954    5579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065957    5579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065960    5579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065964    5579 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065967    5579 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065969    5579 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065972    5579 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065976    5579 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065979    5579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065982    5579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065985    5579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065988    5579 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065991    5579 flags.go:64] FLAG: --help="false"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065995    5579 flags.go:64] FLAG: --hostname-override="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.065998    5579 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066001    5579 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066004    5579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066007    5579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066011    5579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066014    5579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:43:15.073145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066017    5579 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066020    5579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066022    5579 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066026    5579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066029    5579 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066032    5579 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066034    5579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066037    5579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066040    5579 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066043    5579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066047    5579 flags.go:64] FLAG: --lock-file=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066050    5579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066053    5579 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066056    5579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066062    5579 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066065    5579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066068    5579 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066070    5579 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066073    5579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066077    5579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066080    5579 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066082    5579 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066087    5579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066090    5579 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066093    5579 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:43:15.073744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066096    5579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066099    5579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066102    5579 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066105    5579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066108    5579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066111    5579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066114    5579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066121    5579 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066124    5579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066127    5579 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066130    5579 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066133    5579 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066136    5579 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066139    5579 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066142    5579 flags.go:64] FLAG: --port="10250"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066145    5579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066148    5579 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0067a7960d8efacc6"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066152    5579 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066155    5579 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066158    5579 flags.go:64] FLAG: --register-node="true"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066161    5579 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066165    5579 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066168    5579 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066171    5579 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066174    5579 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066177    5579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:43:15.074590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066180    5579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066183    5579 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066187    5579 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066190    5579 flags.go:64] FLAG: --runonce="false"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066192    5579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066196    5579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066199    5579 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066201    5579 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066204    5579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066207    5579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066211    5579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066214    5579 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066217    5579 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066220    5579 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066223    5579 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066226    5579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066229    5579 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066232    5579 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066234    5579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066239    5579 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066242    5579 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066245    5579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066248    5579 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066254    5579 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066257    5579 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:43:15.075261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066260    5579 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066263    5579 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066266    5579 flags.go:64] FLAG: --v="2"
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066275    5579 flags.go:64] FLAG: --version="false"
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066279    5579 flags.go:64] FLAG: --vmodule=""
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066283    5579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066287    5579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066411    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066415    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066417    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066420    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066423    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066425    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066428    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066431    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066434    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066437    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066439    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066442    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066444    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066447    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.076022 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066450    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066453    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066455    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066458    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066461    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066464    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066466    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066469    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066471    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066477    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066479    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066482    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066485    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066487    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066491    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066495    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066497    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066500    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066503    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.076622 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066506    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066508    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066511    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066513    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066516    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066518    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066521    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066523    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066526    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066528    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066531    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066533    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066536    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066538    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066541    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066544    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066547    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066549    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066552    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.077214 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066554    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066557    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066559    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066564    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066567    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066570    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066572    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066575    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066577    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066580    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066583    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066585    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066588    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066590    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066593    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066596    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066598    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066601    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066604    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.077731 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066606    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066609    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066611    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066614    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066616    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066619    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066622    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066624    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066627    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066630    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066632    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066635    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066638    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066640    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066642    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066645    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066651    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066653    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066656    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.078194 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066659    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066661    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066664    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066666    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066669    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066671    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066675    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066679    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066682    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066685    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066688    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066691    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066693    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066696    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066699    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.078658 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066701    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.066726    5579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066759    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066764    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066767    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066769    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066772    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066775    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066778    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066781    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066783    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066786    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066788    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066791    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066796    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066800    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.079085 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066803    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066805    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066808    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066811    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066813    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066816    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066818    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066821    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066825    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066829    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066831    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066834    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066837    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066839    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066842    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066845    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066847    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066850    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066853    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.079527 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066856    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066858    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066861    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066864    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066866    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066869    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066872    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066874    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066877    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066879    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066882    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066885    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066891    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066894    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066896    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066899    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066901    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066904    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066907    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066910    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.080052 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066912    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066915    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066917    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066920    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066922    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066936    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066939    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066943    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066947    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066950    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066952    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066955    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066958    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066960    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066963    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066966    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066969    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066971    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066974    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.080565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066977    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066979    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066982    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066984    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066987    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066992    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066995    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.066998    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067000    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067003    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067005    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067008    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067011    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067013    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067016    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067018    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067021    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067024    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067026    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067029    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.081035 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067031    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067034    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067037    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067040    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067042    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067045    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067047    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067050    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067053    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067056    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067058    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067061    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067063    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.067066    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.071786    5579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.071803    5579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.071822    5579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.071827    5579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071884    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.081581 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071889    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071892    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071896    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071899    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071902    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071904    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071907    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071910    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071913    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071916    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071919    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071921    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071925    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071941    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071946    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071951    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071954    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071956    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071959    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071962    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.082107 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071965    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071967    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071970    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071973    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071976    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071979    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071982    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071985    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071988    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071990    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071993    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071996    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.071998    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072001    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072003    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072006    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072009    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072011    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072014    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072017    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.082810 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072020    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072022    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072025    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072027    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072030    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072033    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072036    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072039    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072042    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072045    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072049    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072053    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072057    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072061    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072065    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072069    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072073    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072077    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072082    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.083321 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072086    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072090    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072094    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072098    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072102    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072107    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072111    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072115    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072120    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072124    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072128    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072132    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072136    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072141    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072145    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072152    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072159    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072163    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072166    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.083788 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072170    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072174    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072177    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072180    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072182    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072185    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072188    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072191    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072193    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072196    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072199    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072202    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072204    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072207    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072210    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072212    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072215    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072218    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072220    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.084714 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072223    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072226    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072228    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072231    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072233    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072236    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072239    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072242    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.072273    5579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072415    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072419    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072423    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072426    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072429    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072433    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.085411 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072437    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072441    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072444    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072447    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072450    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072453    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072455    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072458    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072461    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072463    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072466    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072469    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072472    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072474    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072477    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072480    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072483    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072486    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072489    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.086152 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072492    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072495    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072497    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072500    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072503    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072506    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072509    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072512    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072515    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072517    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072520    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072522    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072525    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072528    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072531    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072533    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072536    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072539    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072542    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072544    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.086642 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072547    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072549    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072552    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072556    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072560    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072563    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072565    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072568    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072570    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072573    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072575    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072578    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072581    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072583    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072586    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072588    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072591    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072594    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072596    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.087136 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072599    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072602    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072604    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072607    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072610    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072612    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072615    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072619    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072623    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072627    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072630    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072633    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072636    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072638    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072641    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072644    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072646    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072649    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072652    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072654    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.087600 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072657    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072659    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072662    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072664    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072667    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072669    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072672    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072674    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072677    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072680    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072682    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072685    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072688    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072690    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072693    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072696    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072698    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072700    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072703    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072705    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.088109 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072708    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072711    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.072737    5579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072769    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072774    5579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072777    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072780    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072782    5579 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072785    5579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072788    5579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072790    5579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072793    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072795    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072798    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072800    5579 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072803    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:15.088587 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072806    5579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072808    5579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072811    5579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072814    5579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072816    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072819    5579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072821    5579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072824    5579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072827    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072830    5579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072833    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072835    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072838    5579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072840    5579 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072843    5579 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072846    5579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072848    5579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072851    5579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072855    5579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072858    5579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:15.089027 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072861    5579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072863    5579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072866    5579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072868    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072871    5579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072873    5579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072876    5579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072879    5579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072883    5579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072886    5579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072890    5579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072893    5579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072895    5579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072898    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072900    5579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072903    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072905    5579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072908    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072910    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:15.089501 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072913    5579 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072916    5579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072919    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072921    5579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072924    5579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072939    5579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072944    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072948    5579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072952    5579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072956    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072960    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072967    5579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072969    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072972    5579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072975    5579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072977    5579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072980    5579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072982    5579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072985    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072988    5579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:15.090106 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072990    5579 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072993    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072995    5579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.072998    5579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073000    5579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073003    5579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073005    5579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073008    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073011    5579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073013    5579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073016    5579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073018    5579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073021    5579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073023    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073026    5579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073028    5579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073031    5579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073033    5579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073036    5579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:15.090717 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073039    5579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073041    5579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073044    5579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073046    5579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073050    5579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073056    5579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073059    5579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073062    5579 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073064    5579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073067    5579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073070    5579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073072    5579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073075    5579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073077    5579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:15.073082    5579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.073140    5579 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074101    5579 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074156    5579 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:43:15.091337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074344    5579 server.go:1014] "Starting client certificate rotation"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074488    5579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074537    5579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:37:03 +0000 UTC" deadline="2028-04-22 02:35:35.422451559 +0000 UTC"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074577    5579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12940h52m20.347876126s"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.074800    5579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.075958    5579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.077118    5579 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.078966    5579 log.go:25] "Validated CRI v1 image API"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.079673    5579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:43:15.092086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.081762    5579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cd0a692-1000-47c3-9a9f-261faf4404ca:/dev/nvme0n1p4 d3eae9bc-804a-4a80-a6f1-b3061cd642c9:/dev/nvme0n1p3]
Oct 30 21:43:15.092522 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.081781    5579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147/userdata/shm major:0 minor:71 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a/userdata/shm major:0 minor:371 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63/userdata/shm major:0 minor:330 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b/userdata/shm major:0 minor:248 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c/userdata/shm major:0 minor:376 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26/userdata/shm major:0 minor:249 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2/userdata/shm major:0 minor:374 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f/userdata/shm major:0 minor:365 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b793d58bc1b5b9840014737525036e240e1a04012dec336a0b505646f7b14e00/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b793d58bc1b5b9840014737525036e240e1a04012dec336a0b505646f7b14e00/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0875aed8-0caa-4fce-9b91-ec25b54c9767/volumes/kubernetes.io~projected/kube-api-access-qgqbh:{mountpoint:/var/lib/kubelet/pods/0875aed8-0caa-4fce-9b91-ec25b54c9767/volumes/kubernetes.io~projected/kube-api-access-qgqbh major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/132d08bc-26d2-4b7d-baa7-09acc3efad7f/volumes/kubernetes.io~projected/kube-api-access-wcnvg:{mountpoint:/var/lib/kubelet/pods/132d08bc-26d2-4b7d-baa7-09acc3efad7f/volumes/kubernetes.io~projected/kube-api-access-wcnvg major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~projected/kube-api-access-xrr9c:{mountpoint:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~projected/kube-api-access-xrr9c major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~projected/kube-api-access-h8s4b:{mountpoint:/var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~projected/kube-api-access-h8s4b major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~secret/metrics-certs major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~projected/kube-api-access-9t6w8:{mountpoint:/var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~projected/kube-api-access-9t6w8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a687a1a-42ac-4478-96d1-5f0aec1df5ff/volumes/kubernetes.io~projected/kube-api-access-rntwg:{mountpoint:/var/lib/kubelet/pods/2a687a1a-42ac-4478-96d1-5f0aec1df5ff/volumes/kubernetes.io~projected/kube-api-access-rntwg major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~projected/kube-api-access-9js5w:{mountpoint:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~projected/kube-api-access-9js5w major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~projected/kube-api-access-qpwf6:{mountpoint:/var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~projected/kube-api-access-qpwf6 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~projected/kube-api-access-585f6:{mountpoint:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~projected/kube-api-access-585f6 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~projected/kube-api-access-7v62q:{mountpoint:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~projected/kube-api-access-7v62q major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5cf73114-c86c-4008-9ff5-59db6b792f59/volumes/kubernetes.io~projected/kube-api-access-qfvf4:{mountpoint:/var/lib/kubelet/pods/5cf73114-c86c-4008-9ff5-59db6b792f59/volumes/kubernetes.io~projected/kube-api-access-qfvf4 major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61b378c7-d792-4388-bc7c-44d06dc47bf0/volumes/kubernetes.io~projected/kube-api-access-s7qd2:{mountpoint:/var/lib/kubelet/pods/61b378c7-d792-4388-bc7c-44d06dc47bf0/volumes/kubernetes.io~projected/kube-api-access-s7qd2 major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~projected/kube-api-access-xm84s:{mountpoint:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~projected/kube-api-access-xm84s major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/91da06b6-dab9-4b20-b18a-9f751e52f6ab/volumes/kubernetes.io~projected/kube-api-access-dv9hc:{mountpoint:/var/lib/kubelet/pods/91da06b6-dab9-4b20-b18a-9f751e52f6ab/volumes/kubernetes.io~projected/kube-api-access-dv9hc major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b2aa126-a4b7-4494-8325-a0e5af72a287/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9b2aa126-a4b7-4494-8325-a0e5af72a287/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~projected/kube-api-access-nkgcw:{mountpoint:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~projected/kube-api-access-nkgcw major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aea1543f-520c-4e59-8cd8-3228d705eccb/volumes/kubernetes.io~projected/kube-api-access-kx5m2:{mountpoint:/var/lib/kubelet/pods/aea1543f-520c-4e59-8cd8-3228d705eccb/volumes/kubernetes.io~projected/kube-api-access-kx5m2 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~projected/kube-api-access-jxgq9:{mountpoint:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~projected/kube-api-access-jxgq9 major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/config-reloader/2 major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/prometheus/15 major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~empty-dir/config-out major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/kube-api-access-pqrs4:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/kube-api-access-pqrs4 major:0 minor:364 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/tls-assets major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/config major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/web-config major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~projected/kube-api-access-dcgdx:{mountpoint:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~projected/kube-api-access-dcgdx major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~projected/kube-api-access-wxklh:{mountpoint:/var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~projected/kube-api-access-wxklh major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f51df616-11c7-429e-a475-aeb655678373/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/f51df616-11c7-429e-a475-aeb655678373/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/b341fcf5fd655fa2e269d58a633cdc8ea13e84b67717a0e6e1bbe639ccc7b24e/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/c6bbfdce55a57205e45bbbe5d873e677f72032a0c0025173762875e5c3f37925/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/2223a85307685c2843f650df6637f05f3b0ee80c76df9745a3428debde7a7e4a/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/424bf1528d7183565ee48ba49c780e751cfbd37d501e91072c3471e029880c5f/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/c4525b023bb8676ad78768dd180df3ee04dbf92bf5e759c17e571d32fcf22c45/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/cedbc25e60ce24c591bd2f8437b47526cbb0cc11b21f26004397b44d7504c8f9/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/cab855f0cd2ba9d6ad1ce23c2ad61ba3ece225b02eb6fdac7aa1f25b37c9d3a0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/70d2de2dae9aaf9b88d1ce3015565c791d21348103fac8066f9fb56112a3f57b/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/7af5aa99f37f7540263595c4336636e85c137d018b20c94000f144e373a1b262/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/eb297ac3d6950303a02251e0f553d346a9cd15d4a626f57c84136db7ccb0abae/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/949e1ce81f3b16bc3506fd1fcd57f88a37d5023da5ff13387ae83ba6300d29a0/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/1473e3553a49bd108885f2c76bf4284964d78f7c1db75a77069693ab1a6645f5/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/57eff53ff3b6e0b171123ea819284db508084edddacc9854c70c534a5e068611/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/b1c52ec576c03bfd6d438a16dba4e86bb4da9b82bb36262c585e8ad180a9bdd5/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/1d042c69c5db1217a540124222900967e8d01941d383873c7d7904fa2447f85f/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/9af5f40e317ee50e9699313e41949c3850ee47c652a18b06da2012361c8bfc15/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/3d9d21b574d5af47d7cb310981300a54947868cec55fbdfff8209e83dce1a7f3/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/64b79d1a1e2a94621106522f4ad83ca91a4740b2ae8d0135cab946958bf3eb91/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/b33a7838d370206006618a66bae009bedf308c6ab8f797e159c45979e48821d6/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/9c732899f40ea268e19d8943fb237ee3db2a1ed3056a60739c0786deea8d401a/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-189:{mountpoint:/var/lib/containers/storage/overlay/6bc4d6cefaa89db68eca403bab45349490895b44a1c6466fe2d268f8daa50994/merged major:0 minor:189 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/55ec0fa00d968a9f07886d87c17caa6790c61e1d097aa32608c6b0d29d1ea657/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/6101e3876ef048edcce5822ec9a4fbb23acc9256f203601c3e14bc1f85e30064/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/5334b8e89831fef74a752bef8b6c06e41417735490cd76fc94d6425dadba9c3f/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/db4c1325b46253d411176f5c401fd7422405f00e722490415ff80301d9cfc3ae/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-224:{mountpoint:/var/lib/containers/storage/overlay/aa8bd5581a8482202cb87bd12f9a06886a82f4701f7e75edf66124ec906d4406/merged major:0 minor:224 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/04d38eccdd87aa9ed3b8a260e1155f3b9ddfdbfed0f16438d515be81389b2c2e/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/270f932b79f20ff546e1d7c82f706cdd94e33aa44f1105811c1f7e91e644c354/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/4c1f9c710221775fefbf9ea34e17614a26301973720739197f1211ff36da93b5/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/44164471e57e821a1c9aaf72711690ec24eb1021684812e411087269d0b72a6a/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/3452e76a4fc050e640df446ed3e4901714a2ddcbb6fe764f87fd7e5f5651b748/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/7a8c82bd43fc9cd7e3e48d6773c97b074122778bb1ca27c2303e642c914238d7/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/5d8fbbf92b2e501d3beeab19f4a676a7409a81965380cbfcdb4dcf4a70875d27/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/7ee024c2dc0bd9598aae35ecb2037e94837cd37ffde06807014850cc6bb32df3/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/a0001ec2e1f47dc6fd07ae26b00bc4cc239ae7ddd23b48f763b5c42a5bbbab32/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/63d45e462107a6730904584b3f4b46c6367a7846be71870745a9cbab4c4ba1f3/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/49f980d392cec8794f0b603a5377e397181f7247b21ddccc0a9a253012decea5/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-288:{mountpoint:/var/lib/containers/storage/overlay/ff94ca5d6c706c47ddc95690c03c7fc08ec473da475a9a6aad0a0723a8a42ab2/merged major:0 minor:288 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/1fb5472168d295565e50d0e9763d67fb170a529de96ebb5d426efccfe4af5b79/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/a917c77af823882bca96496df032f096bb28da4a65def6905e679cbfb87be343/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/048b9b9b035dd4e834e824d3fd678ea29a4a2028f5d91d048b73e9a4b7544427/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/ffd4fc3528c35e6b16a23e7e02c77f768cae962fa0e7aef270ee8c91ce4495f3/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/cb41d56ffbc7bce81992d0acf47c46a42868b67caa9057090a1002a49f876c73/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/983d0e342e6541e523c33be04eb476487dba28da0eb4e241f5e182838117444a/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/87d14debb3d19debf21d9d7f5552bab66fb77bacc416f8e9495a9fc0306815b2/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/566822f5aad83d475d8b62d7198a937486831835a1a092e945fd390ca350203d/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/c636a254b41a8c1d6108a06afbe2fb72b88bbef4146651fecbb7cfac85cc2bd8/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/bb7a0cbc516a142ff4be90a7b365e21d2b82fe513a5c71152bd1681770ccaa0a/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/1de5ebc62bb659f00c8dfbefffe29c1746b824778834ee8b8c05f9237efe6d01/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/a4d8da636a0cad82ce47bb4ecbb2de258abf976f1fbd93384e14552f37eda03c/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/9d00c76077b91953a0c042ad97a7bf3cd88d711207c77008945a0b9351307c7e/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/0b17ce29cae20bb9f011e532ce6f02638342edfac5cc74bca34ba4f3cab0fc63/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/6007b60ecbeb4c5402f0753cb17c1ecacbfa1f6d05f0435a13920b22baace23d/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/1077e59afae3b854ccd6aa6480d335591cef17c97f59d9b6e69294b0e5d94c7a/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/d5ed980e1891acc436c556b5630bd80422751c5caf3923cd75eb2e9b76dcb745/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/994d6045736b16a864c57ed7221cafd9b91e642401a24c4c35f0babd537e14a5/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/66ce5e6657e5cbef066f3e2ba50e61834534f2d8a882db470def20ec583a91ff/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/20f03ecdf65ee595cc202915aebe5222b2f234591ed94ad50dec104712ab84a3/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/1819178f6b405ff5c3241368e2a5d94574cb419f29ff16725806ef69236fefd4/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/031ca7007b992ff99357afb6649aceef1a9cbf19e3947d152a6f222845d3493d/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-428:{mountpoint:/var/lib/containers/storage/overlay/1100298573a1f3ad07a99bfbe82462e0361168bedfc53bf1553f1d38141fe771/merged major:0 minor:428 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/f5e6744eec0eff30513f1b55c5b87a1741e77854bbbca437e96b98f25f6e22ff/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/e85cb46593eec75e7653df9439f4e9796abcbbd50c5aa1a5762659e129db0e26/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/8fe2df659fdee76e084d4a987012a8b7f37854e1afb630144920e08846556fd8/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/d0ffaaff47dc3655cab7f5f11087d5a6302b021004c378035131b1bb780eabe4/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/519a2ea2485f561e5045e61519874e3d165ac5276e8e50cd6dce4b6923638806/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/74f96ed48089ce8f7f46682e007edbc39ff90f9181ccf89db5b0302d93e692ed/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/01dd8d5b2ac00bfc91f3b0bd2eb98cc46354bc4f8e5ccc8c7c48c17e3d6a3d96/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/76d8bdd7b25d2d0671bdbeecbe2f3f288f23ad1d0dfaabccda7e3951c5b10100/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/36e3997d2844c0ae16198fd0b3332de28afecf3ccba4fd06ec019e15a998649f/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/a7cd25c411fefeba5c9c25458206465d3fbe7888295f2d03365cd43be2dce8c4/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.090558    5579 manager.go:217] Machine: {Timestamp:2026-10-30 21:43:15.090057033 +0000 UTC m=+0.059903433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098967 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2119e139414e651f7a3d9916cf8641 SystemUUID:ec2119e1-3941-4e65-1f7a-3d9916cf8641 BootID:871ffe7f-1c82-4400-ad9a-96e5f83e420e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~projected/kube-api-access-dcgdx DeviceMajor:0 DeviceMinor:237 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:362 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4bb2bde914d2581b14be599169c6e7b708bf45e5468b3f9e0e8d5ee44f37f28d/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~projected/kube-api-access-xrr9c DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:349 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-428 DeviceMajor:0 DeviceMinor:428 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2edba39be0a1eb2b764d9db7aad0cf9aee7584426b9b36cb4d5a53c7a3a1cd63/userdata/shm DeviceMajor:0 DeviceMinor:330 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/260f1f78baf47d24a4275da1c86f621aaaece951e9030256243270dd53596147/userdata/shm DeviceMajor:0 DeviceMinor:71 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:357 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/91da06b6-dab9-4b20-b18a-9f751e52f6ab/volumes/kubernetes.io~projected/kube-api-access-dv9hc DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-224 DeviceMajor:0 DeviceMinor:224 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:359 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/aea1543f-520c-4e59-8cd8-3228d705eccb/volumes/kubernetes.io~projected/kube-api-access-kx5m2 DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:232 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~projected/kube-api-access-585f6 DeviceMajor:0 DeviceMinor:54 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:212 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9b2aa126-a4b7-4494-8325-a0e5af72a287/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:370 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5cf73114-c86c-4008-9ff5-59db6b792f59/volumes/kubernetes.io~projected/kube-api-access-qfvf4 DeviceMajor:0 DeviceMinor:53 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1851b61321e7263c2706929b2aa341b4bcf63e3284af53fcf75bd5b6b6a91ec6/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b793d58bc1b5b9840014737525036e240e1a04012dec336a0b505646f7b14e00/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-189 DeviceMajor:0 DeviceMinor:189 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d3523d1-477a-444a-ab30-b46b32a844d1/volumes/kubernetes.io~projected/kube-api-access-qpwf6 DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~projected/kube-api-access-7v62q DeviceMajor:0 DeviceMinor:243 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50a899d521967fc1726e50a50c4e2c4c45935337abe787c19aef1359a9491c26/userdata/shm DeviceMajor:0 DeviceMinor:249 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-288 DeviceMajor:0 DeviceMinor:288 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~projected/kube-api-access-xm84s DeviceMajor:0 DeviceMinor:51 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80ed28b4e1d91ac61d3d47f2004395b47e13cbd30414d345e728ec3caf386221/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66c376704f289c289c941e478875c1c22fe24065b12a289ec7fdf82e427845ff/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6a76c87d-760c-46a0-a5ad-6544e28cf233/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:238 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~projected/kube-api-access-nkgcw DeviceMajor:0 DeviceMinor:329 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/51fe10e882e9ecc8417b6c5722f50e290a14f2cf0b6561efbbeb5668b675959e/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d5a0caa936aff8341420c9d29d18544fb45933d9fb4b35a5ce5c428f0c014c7/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c01628e3-8e21-4385-a716-62fbc9adc347/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:358 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5277871d-bce6-4ba0-b3f5-94bf076abb1f/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:50 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/669380aea1df1f97152ef0aa738145eb557a8c2b0c508e52816b4dbf109bad6b/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:316 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:341 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:355 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:356 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/29fa5a72919c95a62404ea8185ac709e4e4d42f2d787c30cc6491424dcc6c26a/userdata/shm DeviceMajor:0 DeviceMinor:371 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/132d08bc-26d2-4b7d-baa7-09acc3efad7f/volumes/kubernetes.io~projected/kube-api-access-wcnvg DeviceMajor:0 DeviceMinor:373 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:357 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/0875aed8-0caa-4fce-9b91-ec25b54c9767/volumes/kubernetes.io~projected/kube-api-access-qgqbh DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~projected/kube-api-access-9t6w8 DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:325 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:360 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:241 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9bcf5bdf-5cf2-406e-8b17-796aa4178e88/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:315 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f/userdata/shm DeviceMajor:0 DeviceMinor:365 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/43bcee6abb36a757920adb4b3d61e62d389b5aee0662234b328292193b40ab7c/userdata/shm DeviceMajor:0 DeviceMinor:376 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61b378c7-d792-4388-bc7c-44d06dc47bf0/volumes/kubernetes.io~projected/kube-api-access-s7qd2 DeviceMajor:0 DeviceMinor:52 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f51df616-11c7-429e-a475-aeb655678373/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~projected/kube-api-access-h8s4b DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17af0d52b21c101312af8768928f0e979d8017c5e9f07e027ba848512cf75720/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:354 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0b65435-0618-4ffe-9505-5be220342375/volumes/kubernetes.io~projected/kube-api-access-wxklh DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:240 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:357 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/552df7e5-21a9-499c-854d-f14654c5e442/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:239 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0da12a2fbf2738a22c18e8e46baf1850790faf72a54573d641aeb83718010440/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:363 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/293c35ac-425f-47eb-b907-31c479810a75/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:336 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes/kubernetes.io~projected/kube-api-access-jxgq9 DeviceMajor:0 DeviceMinor:342 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~projected/kube-api-access-pqrs4 DeviceMajor:0 DeviceMinor:364 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:357 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/22396b43-f6e0-48e7-8234-1ea6368f2584/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:369 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9eaffffc77e21fd98f1115b7c8adddf0884166c00329a58ad4484ed3be52bef2/userdata/shm DeviceMajor:0 DeviceMinor:374 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1626f5af2354e248e72678e648803e2597216a73201100f85ae7c1d1149e35cb/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3e51f73b62a3b5c930f0f164ddad4ddda5d3854d6310820b869f9b3302c2ec5b/userdata/shm DeviceMajor:0 DeviceMinor:248 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:361 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/2a687a1a-42ac-4478-96d1-5f0aec1df5ff/volumes/kubernetes.io~projected/kube-api-access-rntwg DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34fda3c0-2859-4e43-a320-fe86dfa0150b/volumes/kubernetes.io~projected/kube-api-access-9js5w DeviceMajor:0 DeviceMinor:242 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0da12a2fbf2738a MacAddress:ce:34:75:88:06:1d Speed:10000 Mtu:8901} {Name:1626f5af2354e24 MacAddress:a6:d6:e6:dd:b8:71 Speed:10000 Mtu:8901} {Name:29fa5a72919c95a MacAddress:ae:9b:8d:8b:7d:52 Speed:10000 Mtu:8901} {Name:2edba39be0a1eb2 MacAddress:fa:f2:d6:25:4c:54 Speed:10000 Mtu:8901} {Name:43bcee6abb36a75 MacAddress:96:85:01:f2:d3:63 Speed:10000 Mtu:8901} {Name:50a899d521967fc MacAddress:5e:5b:bc:59:b7:17 Speed:10000 Mtu:8901} {Name:631dcb3f08b1254 MacAddress:5a:42:bd:fb:4f:22 Speed:10000 Mtu:8901} {Name:66c376704f289c2 MacAddress:36:2c:61:ce:ba:98 Speed:10000 Mtu:8901} {Name:9bb52dcd95e835f MacAddress:ba:15:dd:bf:db:c3 Speed:10000 Mtu:8901} {Name:9eaffffc77e21fd MacAddress:46:94:8a:79:b8:f3 Speed:10000 Mtu:8901} {Name:b1a81a295f6cbf7 MacAddress:66:ac:60:3f:e9:91 Speed:10000 Mtu:8901} {Name:b793d58bc1b5b98 MacAddress:76:f0:a2:f8:98:d5 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:c6:e5:df:af Speed:0 Mtu:9001} {Name:br-int MacAddress:36:08:89:8c:93:00 Speed:0 Mtu:8901} {Name:ens5 MacAddress:06:ff:c6:e5:df:af Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:16:db:f6:4f:c0:e6 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:de:bf:2a:4c:87:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.090955    5579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091003    5579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091359    5579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091399    5579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-66.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091609    5579 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091622    5579 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091636    5579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091654    5579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.091807    5579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092060    5579 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092202    5579 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092248    5579 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092264    5579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092278    5579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092291    5579 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:43:15.092900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.092303    5579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:43:15.094531 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.093233    5579 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:43:15.094531 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.093246    5579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:15.094531 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.093809    5579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:43:15.096377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096362    5579 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:43:15.096377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096375    5579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:15.096485 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096476    5579 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:43:15.096675 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096665    5579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:43:15.096714 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096694    5579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:43:15.096793 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096784    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096799    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096806    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096811    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096817    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096823    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:43:15.096827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096828    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096835    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096842    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096848    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096862    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096871    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096895    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:43:15.097004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.096901    5579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:43:15.100279 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.100265    5579 server.go:1263] "Started kubelet"
Oct 30 21:43:15.100363 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.100311    5579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:43:15.100459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.100409    5579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:43:15.100509 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.100481    5579 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:43:15.100778 ip-10-0-139-66 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:43:15.102118 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.102054    5579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:43:15.104525 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.102134    5579 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:43:15.107036 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107020    5579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:43:15.107140 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107053    5579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:43:15.107140 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107122    5579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:37:04 +0000 UTC" deadline="2028-06-24 11:47:25.10785923 +0000 UTC"
Oct 30 21:43:15.107250 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107144    5579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14462h4m10.000718614s"
Oct 30 21:43:15.107305 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107259    5579 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:43:15.107305 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107275    5579 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:43:15.107401 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.107372    5579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:43:15.107401 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.107378    5579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:43:15.108618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108527    5579 factory.go:55] Registering systemd factory
Oct 30 21:43:15.108618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108551    5579 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:43:15.108767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108751    5579 factory.go:153] Registering CRI-O factory
Oct 30 21:43:15.108835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108771    5579 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:43:15.108835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108822    5579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:43:15.108945 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108842    5579 factory.go:103] Registering Raw factory
Oct 30 21:43:15.108945 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.108857    5579 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:43:15.109172 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.109159    5579 manager.go:319] Starting recovery of all containers
Oct 30 21:43:15.110574 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110533    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" volumeName="kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110578    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b378c7-d792-4388-bc7c-44d06dc47bf0" volumeName="kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110592    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a76c87d-760c-46a0-a5ad-6544e28cf233" volumeName="kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110607    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110621    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110636    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110653    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c01628e3-8e21-4385-a716-62fbc9adc347" volumeName="kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110667    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca" seLinuxMountContext=""
Oct 30 21:43:15.110689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110681    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110695    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110709    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110722    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110734    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110746    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110762    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110785    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0875aed8-0caa-4fce-9b91-ec25b54c9767" volumeName="kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110800    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110825    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110838    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110850    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110862    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110873    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f51df616-11c7-429e-a475-aeb655678373" volumeName="kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110887    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110899    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" volumeName="kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110913    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5277871d-bce6-4ba0-b3f5-94bf076abb1f" volumeName="kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110940    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a76c87d-760c-46a0-a5ad-6544e28cf233" volumeName="kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110954    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91da06b6-dab9-4b20-b18a-9f751e52f6ab" volumeName="kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110966    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110985    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.110997    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22396b43-f6e0-48e7-8234-1ea6368f2584" volumeName="kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111009    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" volumeName="kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111027    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" volumeName="kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111039    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111053    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5277871d-bce6-4ba0-b3f5-94bf076abb1f" volumeName="kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111068    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111081    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a76c87d-760c-46a0-a5ad-6544e28cf233" volumeName="kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111095    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="293c35ac-425f-47eb-b907-31c479810a75" volumeName="kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111106    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5277871d-bce6-4ba0-b3f5-94bf076abb1f" volumeName="kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111118    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111130    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111149    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config" seLinuxMountContext=""
Oct 30 21:43:15.111147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111162    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="132d08bc-26d2-4b7d-baa7-09acc3efad7f" volumeName="kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111177    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111190    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159a51e4-6c79-42ff-ae2c-220f5e3046b0" volumeName="kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111203    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d3523d1-477a-444a-ab30-b46b32a844d1" volumeName="kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111215    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111228    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5cf73114-c86c-4008-9ff5-59db6b792f59" volumeName="kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111240    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111253    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111266    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d3523d1-477a-444a-ab30-b46b32a844d1" volumeName="kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111279    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111290    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111304    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea1543f-520c-4e59-8cd8-3228d705eccb" volumeName="kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111316    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111329    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b65435-0618-4ffe-9505-5be220342375" volumeName="kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111341    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d3523d1-477a-444a-ab30-b46b32a844d1" volumeName="kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111363    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111375    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b2aa126-a4b7-4494-8325-a0e5af72a287" volumeName="kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111388    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111400    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea1543f-520c-4e59-8cd8-3228d705eccb" volumeName="kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111412    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111425    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111438    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111450    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d3523d1-477a-444a-ab30-b46b32a844d1" volumeName="kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111463    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b378c7-d792-4388-bc7c-44d06dc47bf0" volumeName="kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111477    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111491    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea1543f-520c-4e59-8cd8-3228d705eccb" volumeName="kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111503    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111515    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c01628e3-8e21-4385-a716-62fbc9adc347" volumeName="kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111527    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0b65435-0618-4ffe-9505-5be220342375" volumeName="kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111544    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111555    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111570    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="293c35ac-425f-47eb-b907-31c479810a75" volumeName="kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111582    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="293c35ac-425f-47eb-b907-31c479810a75" volumeName="kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111596    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111608    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111625    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111637    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111650    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0875aed8-0caa-4fce-9b91-ec25b54c9767" volumeName="kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111670    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="293c35ac-425f-47eb-b907-31c479810a75" volumeName="kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111683    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111696    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111709    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111721    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c01628e3-8e21-4385-a716-62fbc9adc347" volumeName="kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111733    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5277871d-bce6-4ba0-b3f5-94bf076abb1f" volumeName="kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111746    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111757    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="552df7e5-21a9-499c-854d-f14654c5e442" volumeName="kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111769    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91da06b6-dab9-4b20-b18a-9f751e52f6ab" volumeName="kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111782    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcf5bdf-5cf2-406e-8b17-796aa4178e88" volumeName="kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111795    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" volumeName="kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111807    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f51df616-11c7-429e-a475-aeb655678373" volumeName="kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111820    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22396b43-f6e0-48e7-8234-1ea6368f2584" volumeName="kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111832    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5277871d-bce6-4ba0-b3f5-94bf076abb1f" volumeName="kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111844    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" volumeName="kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111857    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c01628e3-8e21-4385-a716-62fbc9adc347" volumeName="kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111869    5579 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34fda3c0-2859-4e43-a320-fe86dfa0150b" volumeName="kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls" seLinuxMountContext=""
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111882    5579 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:43:15.112667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.111890    5579 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:43:15.136786 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.136749    5579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:43:15.138687 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.138660    5579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:43:15.138687 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.138688    5579 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:43:15.138849 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.138711    5579 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:43:15.138849 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.138753    5579 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:43:15.160421 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.160388    5579 generic.go:356] "Generic (PLEG): container finished" podID="34fda3c0-2859-4e43-a320-fe86dfa0150b" containerID="e6b357b76054650fbb211f95b02209ccfc4e2ad0775c0aba5cddad0f2abde3d9" exitCode=0
Oct 30 21:43:15.166004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.165971    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="745d7ebd2a3466fab1cb82933b701ef624d53299e1f8529fee908ed474310bf5" exitCode=0
Oct 30 21:43:15.166004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.166000    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="8b33be5860bd91ff80658a166772d330aa890ce76ce403ac65f10c8ce97d5874" exitCode=0
Oct 30 21:43:15.166004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.166010    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="244494d6f332afb0e54245075f419170eb5419eb18c3cba03c3e0945c5e440b2" exitCode=0
Oct 30 21:43:15.166207 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.166019    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="d3425078c8aed5639f0b8eb9fc504b144e39fe1d0979b5153a89233e40c158f9" exitCode=0
Oct 30 21:43:15.166207 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.166027    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="c3996d96fd5d8af497543305efbabda936a4535f7929633089170599cb2248a2" exitCode=0
Oct 30 21:43:15.166207 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.166035    5579 generic.go:356] "Generic (PLEG): container finished" podID="2a687a1a-42ac-4478-96d1-5f0aec1df5ff" containerID="92de09ed08cf6d057812e8821699686aebc590808994e82f3d7ea63d46b29d8e" exitCode=0
Oct 30 21:43:15.181377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.181340    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed" exitCode=0
Oct 30 21:43:15.191200 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.191170    5579 generic.go:356] "Generic (PLEG): container finished" podID="fbc66296f1ac47a99ab1c1b04d380e57" containerID="1240fc7db068b3f75a47d57971cdc43879678c9908f92c0e1c630fbce4fb949f" exitCode=0
Oct 30 21:43:15.207448 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.207417    5579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:43:15.212187 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.212164    5579 manager.go:324] Recovery completed
Oct 30 21:43:15.233259 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.233195    5579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:15.235301 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.235273    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:15.235407 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.235315    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:15.235407 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.235328    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:15.237767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.237747    5579 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:43:15.237767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.237763    5579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:15.237909 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.237764    5579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:43:15.237909 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.237839    5579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:43:15.238025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238010    5579 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:43:15.238072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238025    5579 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:43:15.238072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238043    5579 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:43:15.238072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238048    5579 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:43:15.238072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238054    5579 policy_none.go:50] "Start"
Oct 30 21:43:15.238072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238067    5579 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:43:15.238226 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238076    5579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:43:15.238226 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238203    5579 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:43:15.238226 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238209    5579 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:43:15.238226 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238215    5579 policy_none.go:44] "Start"
Oct 30 21:43:15.238646 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238631    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:15.238696 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238659    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:15.238696 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.238669    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:15.238894 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.238883    5579 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 21:43:15.243014 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.242988    5579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:43:15.247404 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247391    5579 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:43:15.247475 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.247425    5579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:43:15.247475 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247434    5579 server.go:87] "Starting device plugin registration server"
Oct 30 21:43:15.247719 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247705    5579 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:43:15.247770 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247719    5579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:43:15.247824 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247805    5579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:43:15.247980 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.247920    5579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:43:15.248081 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.248009    5579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:43:15.248081 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.248018    5579 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:43:15.248165 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.248073    5579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:43:15.247974297Z","UUID":"e207592e-c83d-4bb2-b8c8-d511b3e9a02d","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:43:15.249597 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.249579    5579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:43:15.249688 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.249602    5579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:43:15.249748 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.249727    5579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:43:15.249798 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.249765    5579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-66.us-west-2.compute.internal\" not found"
Oct 30 21:43:15.290672 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.290639    5579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:15.290824 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.290719    5579 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:43:15.292417 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.292387    5579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:15.347845 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.347814    5579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:15.348848 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.348824    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:15.348986 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.348860    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:15.348986 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.348871    5579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-66.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:15.348986 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.348923    5579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.379325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.379294    5579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:15.383157 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.383135    5579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:15.439621 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.439569    5579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"]
Oct 30 21:43:15.440157 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440123    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"4e63feea4e10327df2e22d81d9a9cb4a","Type":"ContainerStarted","Data":"e12c09e12c82aa4cf489b2d0c6805b895a1f89b0d6edcc65de466bdd4f08bffe"}
Oct 30 21:43:15.440203 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440164    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"4e63feea4e10327df2e22d81d9a9cb4a","Type":"ContainerStarted","Data":"addc26c71b4d526adb97e0c9f7d6fdc37e4de0008f522b9ec9c32b0fb31af1d3"}
Oct 30 21:43:15.440240 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440204    5579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.440343 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440328    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerStarted","Data":"b885580b807b67dd1fc3722ccf0b698e9205647bc502acda16f1e35a705a63f7"}
Oct 30 21:43:15.440394 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440347    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerDied","Data":"1240fc7db068b3f75a47d57971cdc43879678c9908f92c0e1c630fbce4fb949f"}
Oct 30 21:43:15.440394 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440360    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal" event={"ID":"fbc66296f1ac47a99ab1c1b04d380e57","Type":"ContainerStarted","Data":"2e2e418ac74544815e39a468a63f0a3ce33e970b5a516ce75f72eea7335e7268"}
Oct 30 21:43:15.440455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.440422    5579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.490237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.490168    5579 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.490360 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.490242    5579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.505392 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.505366    5579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:15.505551 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.505398    5579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:15.505551 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.505419    5579 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.505551 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:15.505437    5579 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.591782 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.591753    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.591782 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.591785    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.592010 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.591802    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.692874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692839    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.692874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692790    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.693094 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692903    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.693094 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692923    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.693094 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692978    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e63feea4e10327df2e22d81d9a9cb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"4e63feea4e10327df2e22d81d9a9cb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:15.693094 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:15.692983    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbc66296f1ac47a99ab1c1b04d380e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" (UID: \"fbc66296f1ac47a99ab1c1b04d380e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:16.092674 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.092634    5579 apiserver.go:52] "Watching apiserver"
Oct 30 21:43:16.203607 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.203578    5579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:16.203758 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.203711    5579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:16.236128 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.236095    5579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:43:16.236845 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.236814    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dm5lq","openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd","openshift-console/console-96cc8c648-h9rxd","openshift-monitoring/node-exporter-p5j5z","openshift-network-diagnostics/network-check-target-s8spg","openshift-multus/multus-f65sz","kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal","openshift-network-operator/iptables-alerter-rpwqf","openshift-ovn-kubernetes/ovnkube-node-fp26p","openshift-dns/dns-default-dqh2j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal","kube-system/global-pull-secret-syncer-t84qg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp","openshift-ingress-canary/ingress-canary-bnr7q","openshift-dns/node-resolver-gkkhd","openshift-image-registry/node-ca-ptsl8","openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm","kube-system/konnectivity-agent-xzx5c","openshift-multus/multus-additional-cni-plugins-g8jl6","openshift-monitoring/metrics-server-7b5c75f669-74m79","openshift-console/console-76844b94c8-lpxn9","openshift-monitoring/prometheus-k8s-0","openshift-multus/network-metrics-daemon-4cfvw","openshift-cluster-node-tuning-operator/tuned-jnqlp"]
Oct 30 21:43:16.262300 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.262276    5579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:16.262300 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.262284    5579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:16.262490 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:16.262341    5579 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:16.262490 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:16.262349    5579 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal"
Oct 30 21:43:16.290155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290127    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:43:16.290328 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290309    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:43:16.290417 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290340    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:43:16.290645 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290620    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8c5b8\""
Oct 30 21:43:16.290873 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290759    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:43:16.290963 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290863    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wvvdp\""
Oct 30 21:43:16.290963 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290923    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmtv9\""
Oct 30 21:43:16.290963 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290946    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6s2r8\""
Oct 30 21:43:16.291101 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.290993    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hdwjf\""
Oct 30 21:43:16.291101 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291001    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5r6kl\""
Oct 30 21:43:16.291101 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291019    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s2ds7\""
Oct 30 21:43:16.291101 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291040    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rx46t\""
Oct 30 21:43:16.291314 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291300    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58hb8\""
Oct 30 21:43:16.291361 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291304    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qk7p\""
Oct 30 21:43:16.291361 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291346    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:43:16.291513 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291466    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:43:16.291574 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291525    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-48hj5\""
Oct 30 21:43:16.291574 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291534    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:43:16.291574 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291540    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:43:16.291701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291603    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.291701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291621    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vwlkq\""
Oct 30 21:43:16.291701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291621    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.291701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291644    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.291701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291696    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.291865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291745    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:43:16.291865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291769    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.291865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291837    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.291865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291848    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291893    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291901    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291907    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.291965    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292019    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292063    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.292088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292087    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292115    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292119    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292130    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292136    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292149    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292304 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292179    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.292523 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292350    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.292523 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292406    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:43:16.292523 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292493    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:43:16.292723 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.292703    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:43:16.310449 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.310426    5579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:43:16.337596 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.337572    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:43:16.390905 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.390876    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:43:16.390905 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.390887    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:43:16.391185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.390996    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:43:16.391185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391023    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:43:16.391185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391013    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:43:16.391185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391048    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 21:43:16.391185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391095    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 21:43:16.391392 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391322    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:43:16.391392 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391372    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:43:16.391503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391485    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:43:16.391574 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391560    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0p0f59amjb8k\""
Oct 30 21:43:16.391618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391560    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:43:16.391618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391579    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:43:16.391618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391593    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 21:43:16.391618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391565    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:43:16.391786 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.391774    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.392096 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392074    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 21:43:16.392178 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392113    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lcbz6\""
Oct 30 21:43:16.392178 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392136    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3vt23c124vbse\""
Oct 30 21:43:16.392178 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392143    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:43:16.392363 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392345    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.392424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392380    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:43:16.392424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392401    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 21:43:16.392424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392417    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 21:43:16.392524 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392506    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jxkz7\""
Oct 30 21:43:16.392573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392527    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:43:16.392573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392550    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 21:43:16.392573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392507    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.392573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392561    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:43:16.392573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392553    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-ssgdc\""
Oct 30 21:43:16.392795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392566    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.392795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392599    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-blx25\""
Oct 30 21:43:16.392865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392802    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:43:16.392946 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392917    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 21:43:16.392946 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392922    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:43:16.393089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.392997    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:43:16.393089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.393020    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 21:43:16.393089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.393021    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 21:43:16.393283 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.393265    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j86j7\""
Oct 30 21:43:16.393359 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.393297    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 21:43:16.393413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.393394    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:43:16.394125 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394107    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.394201 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394128    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2p7rl\""
Oct 30 21:43:16.394282 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394266    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:43:16.394335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394314    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hv9kv\""
Oct 30 21:43:16.394391 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394379    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hd8j5\""
Oct 30 21:43:16.394449 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394395    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:43:16.394481 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394449    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:43:16.394524 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394510    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 21:43:16.394838 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394822    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-br247\""
Oct 30 21:43:16.394901 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394888    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:43:16.394961 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.394951    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:43:16.395382 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.395364    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:43:16.395682 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.395662    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 21:43:16.397342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397323    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.397413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397351    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.397413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397367    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:43:16.397413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397383    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.397557 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397471    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.397557 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397564    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.397697 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397680    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.397697 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397685    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-daemon-config\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.397794 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397696    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51df616-11c7-429e-a475-aeb655678373-konnectivity-ca\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:43:16.397794 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397697    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0875aed8-0caa-4fce-9b91-ec25b54c9767-iptables-alerter-script\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.397794 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397735    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.397794 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397771    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-textfile\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.398006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397788    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.398006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397838    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v62q\" (UniqueName: \"kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.398006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397940    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.398006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397964    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.398006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.397992    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.398196 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398016    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.398196 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398019    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-tls\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.398450 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398076    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.398549 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398534    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.398611 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398575    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.398663 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398643    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.398716 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398681    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.398762 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398740    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b378c7-d792-4388-bc7c-44d06dc47bf0-serviceca\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.398807 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.398723    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.399104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399086    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.399191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399154    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.399264 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399191    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwf6\" (UniqueName: \"kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.399264 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399255    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.399372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399290    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.399372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399334    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.399452 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399375    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.399452 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399384    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.399537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399471    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.399537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399511    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9hc\" (UniqueName: \"kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.399625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399542    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585f6\" (UniqueName: \"kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.399625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399569    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.399625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399601    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.399625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399613    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.399808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399634    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.399808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399731    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-tmp\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.399808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399756    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.399808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399800    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.400057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399863    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.400057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399880    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399919    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.400057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.399961    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400040    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400085    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400096    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400097    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400222    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-audit-log\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400230    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.400303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400285    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.400595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400312    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400338    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.400595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400416    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qd2\" (UniqueName: \"kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.400595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400509    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400769 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400652    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.400769 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400687    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.400769 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400736    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.400900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400875    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-tuned\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.400970 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400916    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.401015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.400973    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.401015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401006    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.401166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401032    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.401166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401134    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.401250 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401177    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.401250 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401209    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.401250 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401241    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8s4b\" (UniqueName: \"kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:16.401396 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401266    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.401396 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401297    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.401491 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401393    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.401491 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401429    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.401491 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401458    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.401639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401497    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.401639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401532    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.401639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401564    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.401639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401596    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.401639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401627    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.401874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401667    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.401874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401699    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqbh\" (UniqueName: \"kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.401874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401717    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.401874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401727    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.401874 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401759    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.402139 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.401882    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/552df7e5-21a9-499c-854d-f14654c5e442-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.402205 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402134    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-metrics-server-audit-profiles\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.402287 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402265    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.402339 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402320    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.402551 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402529    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.402629 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402596    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/293c35ac-425f-47eb-b907-31c479810a75-tmp-dir\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.402682 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402648    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.402733 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402686    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.402775 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402740    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.402829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402720    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.402829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402809    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.402955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402842    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.402955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402881    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.403071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402971    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-client-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.403071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.402983    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.403071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403034    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:43:16.403071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403068    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvf4\" (UniqueName: \"kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.403247 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403099    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.403247 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403129    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.403247 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403163    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.403398 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403265    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.403398 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403310    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.403398 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403349    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.403398 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403380    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.403579 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403416    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5m2\" (UniqueName: \"kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.403579 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403451    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.403689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403668    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-tls\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.403742 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403728    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea1543f-520c-4e59-8cd8-3228d705eccb-cni-binary-copy\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.403971 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.403947    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d3523d1-477a-444a-ab30-b46b32a844d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.404146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404114    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.404146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404127    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.404275 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404165    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2aa126-a4b7-4494-8325-a0e5af72a287-original-pull-secret\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.404275 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404174    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.404275 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404223    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.404275 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404261    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.404455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404331    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b65435-0618-4ffe-9505-5be220342375-cert\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:43:16.404455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404398    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.404455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404442    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.404582 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404474    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-config\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.404582 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404475    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:16.404582 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404509    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm84s\" (UniqueName: \"kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.404706 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404646    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.404706 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404686    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.404791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404720    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.404791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404744    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgdx\" (UniqueName: \"kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.404791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404774    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.404960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404800    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.405024 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.404986    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.405144 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405118    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.405202 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405184    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.405252 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405206    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.405552 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405504    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.405686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405582    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.405767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405697    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.405767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405718    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.405873 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405828    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.405873 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405832    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22396b43-f6e0-48e7-8234-1ea6368f2584-metrics-certs\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:16.405989 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.405883    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.406425 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406400    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.406518 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406452    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.406518 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406502    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.406712 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406670    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.406712 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406693    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/293c35ac-425f-47eb-b907-31c479810a75-config-volume\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.406895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406766    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.406895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406804    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.406895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406848    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.406895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406875    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.406966    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407013    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407037    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.407213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407148    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.407213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407151    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovnkube-script-lib\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.407306 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407212    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.407306 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407220    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c01628e3-8e21-4385-a716-62fbc9adc347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.407403 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407365    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407403 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407383    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.407495 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407404    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552df7e5-21a9-499c-854d-f14654c5e442-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.407495 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407475    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.407495 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407422    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntwg\" (UniqueName: \"kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.407609 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407548    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.407609 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407574    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407616    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.407707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407641    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.407707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407679    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.407858 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407735    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.407858 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407783    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.407858 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407812    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.407858 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407836    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.407858 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407849    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5277871d-bce6-4ba0-b3f5-94bf076abb1f-env-overrides\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407851    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/552df7e5-21a9-499c-854d-f14654c5e442-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407868    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407910    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407965    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.407992    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408019    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408045    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408054    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408070    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408094    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408107    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408132    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d3523d1-477a-444a-ab30-b46b32a844d1-data-volume\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408194    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408241    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408272    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408286    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408298    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6w8\" (UniqueName: \"kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.408325 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408308    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5277871d-bce6-4ba0-b3f5-94bf076abb1f-ovn-node-metrics-cert\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408335    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408324    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxklh\" (UniqueName: \"kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408382    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408410    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgcw\" (UniqueName: \"kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408436    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408462    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408457    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408486    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408527    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408570    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408617    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408665    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408690    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408694    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408746    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408757    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51df616-11c7-429e-a475-aeb655678373-agent-certs\") pod \"konnectivity-agent-xzx5c\" (UID: \"f51df616-11c7-429e-a475-aeb655678373\") " pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408770    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408772    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408788    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fda3c0-2859-4e43-a320-fe86dfa0150b-metrics-client-ca\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408792    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91da06b6-dab9-4b20-b18a-9f751e52f6ab-tmp-dir\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408792    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408747    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408839    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408874    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408917    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.408967    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409028    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409111    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.409121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409122    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01628e3-8e21-4385-a716-62fbc9adc347-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409156    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409197    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-secret-metrics-server-client-certs\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409265    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409305    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409332    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9js5w\" (UniqueName: \"kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409379    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.410109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.409557    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/293c35ac-425f-47eb-b907-31c479810a75-metrics-tls\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.450750 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.450714    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v62q\" (UniqueName: \"kubernetes.io/projected/552df7e5-21a9-499c-854d-f14654c5e442-kube-api-access-7v62q\") pod \"kube-state-metrics-5dc8d7d89b-5qmgm\" (UID: \"552df7e5-21a9-499c-854d-f14654c5e442\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5qmgm"
Oct 30 21:43:16.451848 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.451821    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"prometheus-k8s-0\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:16.452058 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.452040    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-585f6\" (UniqueName: \"kubernetes.io/projected/5277871d-bce6-4ba0-b3f5-94bf076abb1f-kube-api-access-585f6\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.452412 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.452391    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwf6\" (UniqueName: \"kubernetes.io/projected/4d3523d1-477a-444a-ab30-b46b32a844d1-kube-api-access-qpwf6\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.452700 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.452680    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qd2\" (UniqueName: \"kubernetes.io/projected/61b378c7-d792-4388-bc7c-44d06dc47bf0-kube-api-access-s7qd2\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.454251 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.454232    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9hc\" (UniqueName: \"kubernetes.io/projected/91da06b6-dab9-4b20-b18a-9f751e52f6ab-kube-api-access-dv9hc\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.458879 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.458853    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8s4b\" (UniqueName: \"kubernetes.io/projected/22396b43-f6e0-48e7-8234-1ea6368f2584-kube-api-access-h8s4b\") pod \"network-metrics-daemon-4cfvw\" (UID: \"22396b43-f6e0-48e7-8234-1ea6368f2584\") " pod="openshift-multus/network-metrics-daemon-4cfvw"
Oct 30 21:43:16.459532 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.459513    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqbh\" (UniqueName: \"kubernetes.io/projected/0875aed8-0caa-4fce-9b91-ec25b54c9767-kube-api-access-qgqbh\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.459779 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.459761    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvf4\" (UniqueName: \"kubernetes.io/projected/5cf73114-c86c-4008-9ff5-59db6b792f59-kube-api-access-qfvf4\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.461257 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.461235    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5m2\" (UniqueName: \"kubernetes.io/projected/aea1543f-520c-4e59-8cd8-3228d705eccb-kube-api-access-kx5m2\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.461330 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.461277    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm84s\" (UniqueName: \"kubernetes.io/projected/6a76c87d-760c-46a0-a5ad-6544e28cf233-kube-api-access-xm84s\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.463543 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.463517    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgcw\" (UniqueName: \"kubernetes.io/projected/9bcf5bdf-5cf2-406e-8b17-796aa4178e88-kube-api-access-nkgcw\") pod \"metrics-server-7b5c75f669-74m79\" (UID: \"9bcf5bdf-5cf2-406e-8b17-796aa4178e88\") " pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:16.463639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.463622    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6w8\" (UniqueName: \"kubernetes.io/projected/293c35ac-425f-47eb-b907-31c479810a75-kube-api-access-9t6w8\") pod \"dns-default-dqh2j\" (UID: \"293c35ac-425f-47eb-b907-31c479810a75\") " pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:16.463707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.463623    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/132d08bc-26d2-4b7d-baa7-09acc3efad7f-kube-api-access-wcnvg\") pod \"network-check-target-s8spg\" (UID: \"132d08bc-26d2-4b7d-baa7-09acc3efad7f\") " pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:16.463825 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.463810    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxklh\" (UniqueName: \"kubernetes.io/projected/f0b65435-0618-4ffe-9505-5be220342375-kube-api-access-wxklh\") pod \"ingress-canary-bnr7q\" (UID: \"f0b65435-0618-4ffe-9505-5be220342375\") " pod="openshift-ingress-canary/ingress-canary-bnr7q"
Oct 30 21:43:16.464686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.464662    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntwg\" (UniqueName: \"kubernetes.io/projected/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-kube-api-access-rntwg\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.464880 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.464855    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9js5w\" (UniqueName: \"kubernetes.io/projected/34fda3c0-2859-4e43-a320-fe86dfa0150b-kube-api-access-9js5w\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.465044 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.465028    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"console-96cc8c648-h9rxd\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") " pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:16.465141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.465122    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"console-76844b94c8-lpxn9\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") " pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:16.465625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.465604    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgdx\" (UniqueName: \"kubernetes.io/projected/c01628e3-8e21-4385-a716-62fbc9adc347-kube-api-access-dcgdx\") pod \"openshift-state-metrics-7bd7489957-8hdmd\" (UID: \"c01628e3-8e21-4385-a716-62fbc9adc347\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-8hdmd"
Oct 30 21:43:16.510659 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510622    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510665    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510689    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510713    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510733    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510748    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d3523d1-477a-444a-ab30-b46b32a844d1-crio-socket\") pod \"insights-runtime-extractor-dm5lq\" (UID: \"4d3523d1-477a-444a-ab30-b46b32a844d1\") " pod="openshift-insights/insights-runtime-extractor-dm5lq"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510750    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.510791 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510792    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510799    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-conf-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510806    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-socket-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510827    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510807    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-etc-kubernetes\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510850    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510864    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510868    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510882    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-multus-socket-dir-parent\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510899    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510922    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510967    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-systemd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510974    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-dbus\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510975    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511016    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-bin\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511028    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511031    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.510965    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511056    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511074    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511094    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511113    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-device-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511131    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511137    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-kubelet\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.511150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511160    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511151    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511158    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-multus\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511178    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-ovn\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511220    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511229    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-systemd\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511264    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511292    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a687a1a-42ac-4478-96d1-5f0aec1df5ff-cnibin\") pod \"multus-additional-cni-plugins-g8jl6\" (UID: \"2a687a1a-42ac-4478-96d1-5f0aec1df5ff\") " pod="openshift-multus/multus-additional-cni-plugins-g8jl6"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511295    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-root\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511322    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511341    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511376    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-run\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511377    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511384    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511413    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511440    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511465    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-cnibin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511465    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511499    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511491    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511531    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511539    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-node-exporter-wtmp\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511547    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511553    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysctl-conf\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511511    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511573    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511593    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-hostroot\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511595    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511622    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-sys-fs\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511624    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511647    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511653    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-cni-netd\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511679    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511682    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2aa126-a4b7-4494-8325-a0e5af72a287-kubelet-config\") pod \"global-pull-secret-syncer-t84qg\" (UID: \"9b2aa126-a4b7-4494-8325-a0e5af72a287\") " pod="kube-system/global-pull-secret-syncer-t84qg"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511699    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-sysconfig\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511706    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511730    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-modprobe-d\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511732    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511723    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-kubelet\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511748    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-k8s-cni-cncf-io\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511760    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-netns\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511769    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511791    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511805    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91da06b6-dab9-4b20-b18a-9f751e52f6ab-hosts-file\") pod \"node-resolver-gkkhd\" (UID: \"91da06b6-dab9-4b20-b18a-9f751e52f6ab\") " pod="openshift-dns/node-resolver-gkkhd"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511810    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511831    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34fda3c0-2859-4e43-a320-fe86dfa0150b-sys\") pod \"node-exporter-p5j5z\" (UID: \"34fda3c0-2859-4e43-a320-fe86dfa0150b\") " pod="openshift-monitoring/node-exporter-p5j5z"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511840    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511863    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511866    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-log-socket\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511877    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511866    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-etc-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511909    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-sys\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511914    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511958    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5cf73114-c86c-4008-9ff5-59db6b792f59-registration-dir\") pod \"aws-ebs-csi-driver-node-t9xxp\" (UID: \"5cf73114-c86c-4008-9ff5-59db6b792f59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9xxp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511970    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-host\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511962    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.511994    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-systemd-units\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512008    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512024    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512042    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512058    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512065    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-slash\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.512032 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512072    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512093    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-node-log\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512105    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0875aed8-0caa-4fce-9b91-ec25b54c9767-host-slash\") pod \"iptables-alerter-rpwqf\" (UID: \"0875aed8-0caa-4fce-9b91-ec25b54c9767\") " pod="openshift-network-operator/iptables-alerter-rpwqf"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512108    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-var-lib-cni-bin\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512108    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512132    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-run-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512156    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512179    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-var-lib-openvswitch\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512179    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512220    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512196    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5277871d-bce6-4ba0-b3f5-94bf076abb1f-host-run-netns\") pod \"ovnkube-node-fp26p\" (UID: \"5277871d-bce6-4ba0-b3f5-94bf076abb1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512241    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512261    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512267    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-lib-modules\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512276    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-var-lib-kubelet\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512285    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b378c7-d792-4388-bc7c-44d06dc47bf0-host\") pod \"node-ca-ptsl8\" (UID: \"61b378c7-d792-4388-bc7c-44d06dc47bf0\") " pod="openshift-image-registry/node-ca-ptsl8"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512288    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512309    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-host-run-multus-certs\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512326    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a76c87d-760c-46a0-a5ad-6544e28cf233-etc-kubernetes\") pod \"tuned-jnqlp\" (UID: \"6a76c87d-760c-46a0-a5ad-6544e28cf233\") " pod="openshift-cluster-node-tuning-operator/tuned-jnqlp"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512328    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:16.513817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:16.512364    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea1543f-520c-4e59-8cd8-3228d705eccb-system-cni-dir\") pod \"multus-f65sz\" (UID: \"aea1543f-520c-4e59-8cd8-3228d705eccb\") " pod="openshift-multus/multus-f65sz"
Oct 30 21:43:17.785661 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:17.785625    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dqh2j"
Oct 30 21:43:20.287398 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:20.287365    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:20.567125 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:20.567061    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:21.100734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:21.100694    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:21.115956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:21.115920    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:21.300664 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:21.300633    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:21.301040 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:21.300862    5579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:43:23.220552 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:23.220508    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:24.197002 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:24.196972    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:43:30.133147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:30.133068    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fp26p"
Oct 30 21:43:33.853969 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:33.853911    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzx5c"
Oct 30 21:43:34.865571 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:34.865537    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b5c75f669-74m79"
Oct 30 21:43:41.262587 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.262523    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-96cc8c648-h9rxd" podUID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" containerName="console" containerID="cri-o://8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d" gracePeriod=15
Oct 30 21:43:41.511371 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.511348    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:41.640639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.640607    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.640819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.640683    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.640819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.640717    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.640819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.640754    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641071    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641133    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641141    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641190    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") pod \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\" (UID: \"159a51e4-6c79-42ff-ae2c-220f5e3046b0\") "
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641247    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:41.641473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641447    5579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.641889 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641505    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:43:41.641889 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.641536    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:41.643448 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.643416    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "kube-api-access-xrr9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:41.643538 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.643416    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:41.643538 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.643495    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert" pod "159a51e4-6c79-42ff-ae2c-220f5e3046b0" (UID: "159a51e4-6c79-42ff-ae2c-220f5e3046b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:41.742499 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742462    5579 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159a51e4-6c79-42ff-ae2c-220f5e3046b0-tmp\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.742499 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742493    5579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.742499 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742506    5579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/159a51e4-6c79-42ff-ae2c-220f5e3046b0-oauth-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.742725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742517    5579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.742725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742526    5579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/159a51e4-6c79-42ff-ae2c-220f5e3046b0-console-oauth-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:41.742725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:41.742536    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrr9c\" (UniqueName: \"kubernetes.io/projected/159a51e4-6c79-42ff-ae2c-220f5e3046b0-kube-api-access-xrr9c\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:42.291656 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.291623    5579 generic.go:356] "Generic (PLEG): container finished" podID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" containerID="8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d" exitCode=0
Oct 30 21:43:42.292113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.291670    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96cc8c648-h9rxd"
Oct 30 21:43:42.292113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.291686    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96cc8c648-h9rxd" event={"ID":"159a51e4-6c79-42ff-ae2c-220f5e3046b0","Type":"ContainerDied","Data":"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"}
Oct 30 21:43:42.292113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.291734    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96cc8c648-h9rxd" event={"ID":"159a51e4-6c79-42ff-ae2c-220f5e3046b0","Type":"ContainerDied","Data":"631dcb3f08b1254c5a9e0e419d3c595a1c50ddf4763fe1a59332981fe3f5981f"}
Oct 30 21:43:42.292113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.291752    5579 scope.go:122] "RemoveContainer" containerID="8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"
Oct 30 21:43:42.301188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.301167    5579 scope.go:122] "RemoveContainer" containerID="8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"
Oct 30 21:43:42.301466 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:42.301447    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d\": container with ID starting with 8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d not found: ID does not exist" containerID="8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"
Oct 30 21:43:42.301508 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.301476    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d"} err="failed to get container status \"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d\": rpc error: code = NotFound desc = could not find container \"8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d\": container with ID starting with 8deb1783ead4819f7f23b913e46c0ff905d49fbfb0a0d900a1b282d2e1e7dc5d not found: ID does not exist"
Oct 30 21:43:42.444413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.444374    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:43:42.491216 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:42.491178    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-96cc8c648-h9rxd"]
Oct 30 21:43:42.929504 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:42.929472    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:43:43.144073 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:43.144043    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" path="/var/lib/kubelet/pods/159a51e4-6c79-42ff-ae2c-220f5e3046b0/volumes"
Oct 30 21:43:49.038616 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.038577    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:49.039136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.038984    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="prometheus" containerID="cri-o://a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075" gracePeriod=600
Oct 30 21:43:49.039136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.039024    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d" gracePeriod=600
Oct 30 21:43:49.039136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.039069    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-web" containerID="cri-o://d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8" gracePeriod=600
Oct 30 21:43:49.039136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.039090    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy" containerID="cri-o://47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0" gracePeriod=600
Oct 30 21:43:49.039136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.039099    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="thanos-sidecar" containerID="cri-o://4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd" gracePeriod=600
Oct 30 21:43:49.039392 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.039105    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="config-reloader" containerID="cri-o://b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd" gracePeriod=600
Oct 30 21:43:49.312781 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.312713    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:49.323482 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323449    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d" exitCode=0
Oct 30 21:43:49.323482 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323477    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0" exitCode=0
Oct 30 21:43:49.323482 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323484    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8" exitCode=0
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323493    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd" exitCode=0
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323502    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd" exitCode=0
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323507    5579 generic.go:356] "Generic (PLEG): container finished" podID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075" exitCode=0
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323526    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323538    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323627    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323672    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323689    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323710    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323761    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323796    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"}
Oct 30 21:43:49.324011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.323834    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc07ccf9-72d3-46b6-9533-35b39dbf3d62","Type":"ContainerDied","Data":"b1a81a295f6cbf7f5bc69d7608cc8fb73be3e74c6ad4aea43f2e58ab15fd884f"}
Oct 30 21:43:49.331026 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.331006    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.337421 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.337393    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.346024 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.346002    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.352602 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.352584    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.359214 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.359196    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.366402 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.366387    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.372960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.372941    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.373210 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.373191    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.373273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373222    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.373273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373246    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.373498 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.373481    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.373533 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373506    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.373533 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373520    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.373772 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.373756    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.373822 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373777    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.373822 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.373793    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.374010 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.373992    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.374062 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374015    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.374062 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374029    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.374313 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.374281    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.374352 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374319    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.374352 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374334    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.374581 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.374566    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.374620 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374585    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.374620 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374598    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.374813 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:43:49.374795    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.374881 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374821    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.374881 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.374841    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.375082 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375064    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.375131 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375082    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.375297 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375281    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.375340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375297    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.375483 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375464    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.375548 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375484    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.375686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375671    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.375738 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375685    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.375884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375868    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.375937 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.375883    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.376081 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376061    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.376124 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376080    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.376258 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376242    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.376306 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376258    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.376459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376445    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.376507 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376458    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.376623 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376609    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.376669 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376622    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.376799 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376776    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.376841 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376800    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.377010 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.376995    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.377059 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377009    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.377251 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377235    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.377251 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377251    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.377454 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377440    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.377498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377453    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.377640 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377627    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.377686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377640    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.377875 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377857    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.377953 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.377875    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.378112 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378094    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.378160 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378113    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.378335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378321    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.378374 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378336    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.378562 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378542    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.378609 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378563    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.378800 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378785    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.378844 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.378799    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.379028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379001    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.379068 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379028    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.379226 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379210    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.379275 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379226    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.379435 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379418    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.379469 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379435    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.379641 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379626    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.379690 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379641    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.379849 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379830    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.379920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.379850    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.380131 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380104    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.380131 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380121    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.380338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380319    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.380380 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380339    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.380537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380520    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.380585 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380537    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.380716 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380701    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.380762 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380715    5579 scope.go:122] "RemoveContainer" containerID="fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"
Oct 30 21:43:49.380898 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380877    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d"} err="failed to get container status \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": rpc error: code = NotFound desc = could not find container \"fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d\": container with ID starting with fc6bed0514fae8e5b66242626f328e7014a1b1b2cc6a0d4d16a9b8f10e6ad84d not found: ID does not exist"
Oct 30 21:43:49.380997 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.380900    5579 scope.go:122] "RemoveContainer" containerID="47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"
Oct 30 21:43:49.381145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381130    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0"} err="failed to get container status \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": rpc error: code = NotFound desc = could not find container \"47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0\": container with ID starting with 47feb0dbecda39b92095e75f1e82f7187a595ba4dd4ba80d6f6d1031be462ab0 not found: ID does not exist"
Oct 30 21:43:49.381195 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381145    5579 scope.go:122] "RemoveContainer" containerID="d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"
Oct 30 21:43:49.381362 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381340    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8"} err="failed to get container status \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": rpc error: code = NotFound desc = could not find container \"d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8\": container with ID starting with d82c54288d3f1d9af987f88b2f595e97b6ba2529a26cd00120b1f522a36bbec8 not found: ID does not exist"
Oct 30 21:43:49.381362 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381359    5579 scope.go:122] "RemoveContainer" containerID="4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"
Oct 30 21:43:49.381575 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381559    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd"} err="failed to get container status \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": rpc error: code = NotFound desc = could not find container \"4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd\": container with ID starting with 4b3085de049e770568893a4225cbc0dcc81a1a04a92f8763eefb1c39bc20c4fd not found: ID does not exist"
Oct 30 21:43:49.381689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381575    5579 scope.go:122] "RemoveContainer" containerID="b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"
Oct 30 21:43:49.381820 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381802    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd"} err="failed to get container status \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": rpc error: code = NotFound desc = could not find container \"b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd\": container with ID starting with b74cc20191f61ffa8b67383a0dca963cb7caf84a87739b4d560080d8da63a9fd not found: ID does not exist"
Oct 30 21:43:49.381861 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.381820    5579 scope.go:122] "RemoveContainer" containerID="a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"
Oct 30 21:43:49.382038 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.382019    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075"} err="failed to get container status \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": rpc error: code = NotFound desc = could not find container \"a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075\": container with ID starting with a409fbd22353c741f35ab9e2625f5d5ef75aa53c4d5edf0a00002d4787d93075 not found: ID does not exist"
Oct 30 21:43:49.382089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.382039    5579 scope.go:122] "RemoveContainer" containerID="2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"
Oct 30 21:43:49.382249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.382233    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed"} err="failed to get container status \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": rpc error: code = NotFound desc = could not find container \"2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed\": container with ID starting with 2740893ca146c7802f72832a52d0d266183e7a88466e7d7d1f7825b5224aa1ed not found: ID does not exist"
Oct 30 21:43:49.405121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405095    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405158    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405181    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405302 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405286    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405326    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405348    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405383    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405480 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405412    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405480 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405442    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405480 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405471    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405491    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405517    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405557    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405592    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405628    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405662    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405702    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405753    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405782    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.405907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.405811    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") pod \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\" (UID: \"bc07ccf9-72d3-46b6-9533-35b39dbf3d62\") "
Oct 30 21:43:49.406698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.406420    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.406920    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.406958    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.406967    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.407417    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.407620    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.407920    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.408166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.408074    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:49.409215 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.409176    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:49.409445 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.409399    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.409445 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.409409    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:43:49.410329 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410302    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.410666 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410644    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.410803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410778    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "kube-api-access-pqrs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:49.410883 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410784    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.410883 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410841    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.411009 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.410916    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.411075 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.411038    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.411116 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.411085    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.420271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.420244    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config" pod "bc07ccf9-72d3-46b6-9533-35b39dbf3d62" (UID: "bc07ccf9-72d3-46b6-9533-35b39dbf3d62"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:49.507388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507358    5579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-metrics-client-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507387    5579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-web-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507401    5579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507416    5579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-kube-rbac-proxy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507428    5579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config-out\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507441    5579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507456    5579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507469    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqrs4\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-kube-api-access-pqrs4\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507481    5579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507496    5579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507509    5579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-grpc-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507522    5579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507535    5579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507548    5579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507563    5579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507576    5579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507590    5579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507604    5579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-secret-metrics-client-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507618    5579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-tls-assets\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.507625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.507631    5579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc07ccf9-72d3-46b6-9533-35b39dbf3d62-prometheus-k8s-db\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:43:49.743825 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.743791    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:49.757319 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.757292    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:49.799348 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799315    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:49.799586 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799566    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="thanos-sidecar"
Oct 30 21:43:49.799586 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799585    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="thanos-sidecar"
Oct 30 21:43:49.799920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799611    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="prometheus"
Oct 30 21:43:49.799920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799619    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="prometheus"
Oct 30 21:43:49.799920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799632    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-thanos"
Oct 30 21:43:49.799920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.799640    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-thanos"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800043    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="init-config-reloader"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800065    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="init-config-reloader"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800081    5579 cpu_manager.go:414] "containerMap: removing container" podUID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" containerName="console"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800090    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" containerName="console"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800105    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-web"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800113    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-web"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800129    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800136    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800149    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="config-reloader"
Oct 30 21:43:49.800155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800157    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="config-reloader"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800239    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="thanos-sidecar"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800254    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="prometheus"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800265    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-thanos"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800276    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="init-config-reloader"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800286    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="159a51e4-6c79-42ff-ae2c-220f5e3046b0" containerName="console"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800294    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy-web"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800304    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="kube-rbac-proxy"
Oct 30 21:43:49.800619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.800312    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" containerName="config-reloader"
Oct 30 21:43:49.838532 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.838501    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:49.870764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.870727    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:49.887550 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.887522    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:43:49.887757 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.887599    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:43:49.887757 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.887600    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0p0f59amjb8k\""
Oct 30 21:43:49.888722 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.888706    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:43:49.889101 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889088    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:43:49.889150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889104    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:43:49.889348 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889332    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-br247\""
Oct 30 21:43:49.889458 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889446    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:43:49.889805 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889791    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:43:49.889860 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889828    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:43:49.889958 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889940    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:43:49.889998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889975    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:43:49.889998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889991    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:43:49.890087 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.889999    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:43:49.936969 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.936925    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:43:49.937127 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:49.937077    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012449    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bbm\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-kube-api-access-v6bbm\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012509    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012543    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012578    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012618    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012655    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012680    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012717    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012749    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012788    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012816    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012843    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012884    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012915    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012970    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.012999    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.013038    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.013071    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.013101    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.015377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.013152    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.113747 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113705    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113752    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113772    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113893    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113950    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.113976    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114015    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114052    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bbm\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-kube-api-access-v6bbm\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114128    5579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114151    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114189    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114226    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114261    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114289    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114319    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114358    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114383    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114419    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114443    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114475    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114510    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114558    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.114884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.114603    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.115419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.115163    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.115419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.115237    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.116048 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.116020    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.116845 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.116818    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117032    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117072    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117301    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117301    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117568    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.117998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.117686    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.118699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.118671    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.118899 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.118870    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.119308 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.119284    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.119679 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.119653    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.119811 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.119793    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.119963 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.119923    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-config\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.120408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.120389    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.171865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.171789    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bbm\" (UniqueName: \"kubernetes.io/projected/83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa-kube-api-access-v6bbm\") pod \"prometheus-k8s-0\" (UID: \"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.244973 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.244920    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:43:50.290294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.290262    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s8spg"
Oct 30 21:43:50.720978 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.720808    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:43:50.729745 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:43:50.729718    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b5c3ec_9e57_44bb_9ec4_b5e8788c61fa.slice/crio-b89c14b8d63729e8cce595a16661f8bce1fd7f42b04b68775825ff27d6594b2d WatchSource:0}: Error finding container b89c14b8d63729e8cce595a16661f8bce1fd7f42b04b68775825ff27d6594b2d: Status 404 returned error can't find the container with id b89c14b8d63729e8cce595a16661f8bce1fd7f42b04b68775825ff27d6594b2d
Oct 30 21:43:50.921086 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.921055    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:43:50.923176 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.923154    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931513    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931539    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931719 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931562    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931719 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931606    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931719 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931658    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbjsn\" (UniqueName: \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931838 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931747    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931838 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931786    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.931838 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.931821    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:50.984977 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:50.984878    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:43:51.032627 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032591    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032666    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032708    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032730    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032785    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032822    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.032871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032847    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbjsn\" (UniqueName: \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.033212 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.032884    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.033212 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.033047    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.033590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.033549    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.033743 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.033714    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.034182 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.034159    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.034277 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.034252    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.035400 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.035379    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.035478 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.035429    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.091464 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.091427    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbjsn\" (UniqueName: \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\") pod \"console-5c5bff957d-wmnsj\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") " pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.144772 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.144738    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc07ccf9-72d3-46b6-9533-35b39dbf3d62" path="/var/lib/kubelet/pods/bc07ccf9-72d3-46b6-9533-35b39dbf3d62/volumes"
Oct 30 21:43:51.233670 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.233633    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:43:51.340233 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.340201    5579 generic.go:356] "Generic (PLEG): container finished" podID="83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa" containerID="8d70ca59815ff2bd5d4242c99138eec8f514aeacbe92a45b30eaae687952aa02" exitCode=0
Oct 30 21:43:51.340395 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.340257    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerDied","Data":"8d70ca59815ff2bd5d4242c99138eec8f514aeacbe92a45b30eaae687952aa02"}
Oct 30 21:43:51.340395 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.340304    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"b89c14b8d63729e8cce595a16661f8bce1fd7f42b04b68775825ff27d6594b2d"}
Oct 30 21:43:51.599555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:51.599532    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:43:52.347487 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347446    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"276337102d831822549710ac34c3d0a0b8a4a10c1ead13dfe1f3f3cf1d8cb5cb"}
Oct 30 21:43:52.347981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347547    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"0c5d6d2e1f51ace795779141124212eebbdb13209383d3310cd12a5138282306"}
Oct 30 21:43:52.347981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347582    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"9053c7f1b01e51c14402fe1edc3257c065e78c2282c8e2b7a6a3801b2871f2d9"}
Oct 30 21:43:52.347981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347616    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"0be543366571050212ce22c5e535db1a7384d2e18f810fe24cb8fa97633a5a57"}
Oct 30 21:43:52.347981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347640    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"c2b539835f4738f70be10b8472e19cd11d6fd1ed77d646f821c021c7d7be7cc6"}
Oct 30 21:43:52.347981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.347672    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa","Type":"ContainerStarted","Data":"c3e578e740c44b1a4a6829ae4afcf25f8e45e15b9b2042bae940db73a5e9f0de"}
Oct 30 21:43:52.349126 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.349100    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bff957d-wmnsj" event={"ID":"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6","Type":"ContainerStarted","Data":"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"}
Oct 30 21:43:52.349190 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.349147    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bff957d-wmnsj" event={"ID":"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6","Type":"ContainerStarted","Data":"b7c455357418ea7e5a75af3c9385513c7b2f042411ed04dc70462d7b2bd25329"}
Oct 30 21:43:52.477340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.477285    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.46260679 podStartE2EDuration="3.477271069s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.664279ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:52.476237376 +0000 UTC m=+37.446083821" watchObservedRunningTime="2026-10-30 21:43:52.477271069 +0000 UTC m=+37.447117478"
Oct 30 21:43:52.586223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:52.586174    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5c5bff957d-wmnsj" podStartSLOduration=2.58616102 podStartE2EDuration="2.58616102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:52.58579839 +0000 UTC m=+37.555644798" watchObservedRunningTime="2026-10-30 21:43:52.58616102 +0000 UTC m=+37.556007407"
Oct 30 21:43:55.245744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:43:55.245699    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:44:01.234420 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:01.234376    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:01.234830 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:01.234454    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:01.238982 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:01.238960    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:01.382993 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:01.382962    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:01.547633 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:01.547555    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:44:03.291561 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:03.291514    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:44:03.307087 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:03.307061    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:44:03.401711 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:03.401685    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:44:12.930490 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:44:12.930449    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:44:13.334924 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.334837    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b989c84bc-w75qr"]
Oct 30 21:44:13.337249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.337220    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.408846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.408815    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-trusted-ca-bundle\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.408852    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-service-ca\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.408938    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqnh4\" (UniqueName: \"kubernetes.io/projected/b7cb6920-b91a-4312-9760-9590194ad2c5-kube-api-access-tqnh4\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.408996    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-console-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409127 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.409041    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-oauth-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409127 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.409086    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409189 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.409123    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-oauth-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.409189 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.409146    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7cb6920-b91a-4312-9760-9590194ad2c5-tmp\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.435669 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.435633    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b989c84bc-w75qr"]
Oct 30 21:44:13.510141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510098    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-oauth-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510139    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7cb6920-b91a-4312-9760-9590194ad2c5-tmp\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510383 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510277    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-trusted-ca-bundle\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510383 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510316    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-service-ca\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510383 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510367    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqnh4\" (UniqueName: \"kubernetes.io/projected/b7cb6920-b91a-4312-9760-9590194ad2c5-kube-api-access-tqnh4\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510530 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510386    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-console-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510530 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510408    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-oauth-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510530 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510454    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.510687 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.510573    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7cb6920-b91a-4312-9760-9590194ad2c5-tmp\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.511161 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.511137    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-service-ca\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.511285 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.511180    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-console-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.511285 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.511275    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-oauth-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.511363 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.511283    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cb6920-b91a-4312-9760-9590194ad2c5-trusted-ca-bundle\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.512715 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.512689    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-oauth-config\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.512876 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.512859    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7cb6920-b91a-4312-9760-9590194ad2c5-console-serving-cert\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.564554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.564515    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqnh4\" (UniqueName: \"kubernetes.io/projected/b7cb6920-b91a-4312-9760-9590194ad2c5-kube-api-access-tqnh4\") pod \"console-5b989c84bc-w75qr\" (UID: \"b7cb6920-b91a-4312-9760-9590194ad2c5\") " pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:13.647835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:13.647798    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:14.013848 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:14.013764    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b989c84bc-w75qr"]
Oct 30 21:44:14.021449 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:44:14.021419    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cb6920_b91a_4312_9760_9590194ad2c5.slice/crio-3418de3993ba1b23b56fff481f891f3ce42fa1effba3a3f9e017d12e5b9d84fc WatchSource:0}: Error finding container 3418de3993ba1b23b56fff481f891f3ce42fa1effba3a3f9e017d12e5b9d84fc: Status 404 returned error can't find the container with id 3418de3993ba1b23b56fff481f891f3ce42fa1effba3a3f9e017d12e5b9d84fc
Oct 30 21:44:14.425680 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:14.425636    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b989c84bc-w75qr" event={"ID":"b7cb6920-b91a-4312-9760-9590194ad2c5","Type":"ContainerStarted","Data":"57d4fe0f80ca9bc8c02a0e96b71ff92f7aaee3fd4200681c6605dec52ac163b8"}
Oct 30 21:44:14.425835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:14.425722    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b989c84bc-w75qr" event={"ID":"b7cb6920-b91a-4312-9760-9590194ad2c5","Type":"ContainerStarted","Data":"3418de3993ba1b23b56fff481f891f3ce42fa1effba3a3f9e017d12e5b9d84fc"}
Oct 30 21:44:14.535559 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:14.535351    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5b989c84bc-w75qr" podStartSLOduration=1.535332884 podStartE2EDuration="1.535332884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:14.534657656 +0000 UTC m=+59.504504067" watchObservedRunningTime="2026-10-30 21:44:14.535332884 +0000 UTC m=+59.505179290"
Oct 30 21:44:23.648912 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:23.648864    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:23.649510 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:23.648953    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:23.653871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:23.653850    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:24.462269 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:24.462242    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b989c84bc-w75qr"
Oct 30 21:44:24.618433 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:24.618399    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:44:26.567221 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.567160    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-76844b94c8-lpxn9" podUID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" containerName="console" containerID="cri-o://458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074" gracePeriod=15
Oct 30 21:44:26.814212 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.814186    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:44:26.928452 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928419    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928684 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928489    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928684 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928526    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928684 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928562    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928867 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928694    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928867 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928740    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.928867 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928797    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:26.929050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928852    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.929050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928961    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:26.929050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929035    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") pod \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\" (UID: \"aedf6695-2b79-47e4-b8f7-ce9ffaa24067\") "
Oct 30 21:44:26.929050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.928969    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:26.929271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929250    5579 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-tmp\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:26.929271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929272    5579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-trusted-ca-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:26.929419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929287    5579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:26.929419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929328    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:26.929419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.929383    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:26.930917 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.930896    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:26.931043 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.931015    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "kube-api-access-jxgq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:26.931171 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:26.931151    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config" pod "aedf6695-2b79-47e4-b8f7-ce9ffaa24067" (UID: "aedf6695-2b79-47e4-b8f7-ce9ffaa24067"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:27.030462 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.030424    5579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:27.030462 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.030461    5579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-oauth-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:27.030462 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.030473    5579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:27.030700 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.030483    5579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-console-oauth-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:27.030700 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.030493    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxgq9\" (UniqueName: \"kubernetes.io/projected/aedf6695-2b79-47e4-b8f7-ce9ffaa24067-kube-api-access-jxgq9\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:27.473723 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.473690    5579 generic.go:356] "Generic (PLEG): container finished" podID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" containerID="458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074" exitCode=0
Oct 30 21:44:27.473956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.473747    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76844b94c8-lpxn9"
Oct 30 21:44:27.473956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.473750    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76844b94c8-lpxn9" event={"ID":"aedf6695-2b79-47e4-b8f7-ce9ffaa24067","Type":"ContainerDied","Data":"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"}
Oct 30 21:44:27.473956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.473867    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76844b94c8-lpxn9" event={"ID":"aedf6695-2b79-47e4-b8f7-ce9ffaa24067","Type":"ContainerDied","Data":"9bb52dcd95e835f28a7fef537995460c451b59c49ec331360390a5b3ce6fcb73"}
Oct 30 21:44:27.473956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.473893    5579 scope.go:122] "RemoveContainer" containerID="458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"
Oct 30 21:44:27.481550 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.481528    5579 scope.go:122] "RemoveContainer" containerID="458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"
Oct 30 21:44:27.481832 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:44:27.481812    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074\": container with ID starting with 458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074 not found: ID does not exist" containerID="458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"
Oct 30 21:44:27.481879 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.481842    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074"} err="failed to get container status \"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074\": rpc error: code = NotFound desc = could not find container \"458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074\": container with ID starting with 458e8f3cafbe8c8a085fc94e3522c8d40a305978e2ae9820b8acea486cbc7074 not found: ID does not exist"
Oct 30 21:44:27.628005 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.627974    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:44:27.674271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:27.674239    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76844b94c8-lpxn9"]
Oct 30 21:44:29.143339 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:29.143302    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" path="/var/lib/kubelet/pods/aedf6695-2b79-47e4-b8f7-ce9ffaa24067/volumes"
Oct 30 21:44:42.929132 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:44:42.929096    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:44:49.638249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.638184    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5c5bff957d-wmnsj" podUID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" containerName="console" containerID="cri-o://f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2" gracePeriod=15
Oct 30 21:44:49.885570 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.885545    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:49.934829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.934758    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935003 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.934979    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935083 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935024    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935083    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935112    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935245 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935139    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935245 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935168    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935245 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935237    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\" (UniqueName: \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\") pod \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\" (UID: \"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6\") "
Oct 30 21:44:49.935523 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935497    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:49.935637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935519    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:49.935704 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935647    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:49.935704 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935692    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:49.935852 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.935827    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:49.937084 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.937053    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:49.937179 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.937077    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:49.937496 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:49.937482    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn" pod "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" (UID: "f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6"). InnerVolumeSpecName "kube-api-access-hbjsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:50.036526 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036483    5579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036526 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036518    5579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036526 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036528    5579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-trusted-ca-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036526 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036537    5579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-oauth-serving-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036546    5579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036554    5579 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-tmp\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036563    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbjsn\" (UniqueName: \"kubernetes.io/projected/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-kube-api-access-hbjsn\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.036790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.036572    5579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6-console-oauth-config\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:44:50.553614 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.553577    5579 generic.go:356] "Generic (PLEG): container finished" podID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" containerID="f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2" exitCode=0
Oct 30 21:44:50.553790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.553635    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bff957d-wmnsj" event={"ID":"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6","Type":"ContainerDied","Data":"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"}
Oct 30 21:44:50.553790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.553642    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bff957d-wmnsj"
Oct 30 21:44:50.553790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.553681    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bff957d-wmnsj" event={"ID":"f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6","Type":"ContainerDied","Data":"b7c455357418ea7e5a75af3c9385513c7b2f042411ed04dc70462d7b2bd25329"}
Oct 30 21:44:50.553790 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.553701    5579 scope.go:122] "RemoveContainer" containerID="f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"
Oct 30 21:44:50.567426 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.567399    5579 scope.go:122] "RemoveContainer" containerID="f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"
Oct 30 21:44:50.567785 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:44:50.567767    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2\": container with ID starting with f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2 not found: ID does not exist" containerID="f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"
Oct 30 21:44:50.567855 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.567796    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2"} err="failed to get container status \"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2\": rpc error: code = NotFound desc = could not find container \"f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2\": container with ID starting with f5f9e37dcdf3565517f41c46b0e881c79f956033d1b154516ce7ebb76331e0f2 not found: ID does not exist"
Oct 30 21:44:50.706011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.705973    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:44:50.752514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:50.752481    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c5bff957d-wmnsj"]
Oct 30 21:44:51.144076 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:44:51.144042    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" path="/var/lib/kubelet/pods/f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6/volumes"
Oct 30 21:45:12.929812 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:45:12.929723    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:45:42.928408 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:45:42.928365    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:45:53.524448 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524406    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"]
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524799    5579 cpu_manager.go:414] "containerMap: removing container" podUID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" containerName="console"
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524817    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" containerName="console"
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524833    5579 cpu_manager.go:414] "containerMap: removing container" podUID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" containerName="console"
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524841    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" containerName="console"
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524949    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3eaf7e7-681a-4293-9dfe-ba87bd32b6f6" containerName="console"
Oct 30 21:45:53.525105 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.524963    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="aedf6695-2b79-47e4-b8f7-ce9ffaa24067" containerName="console"
Oct 30 21:45:53.528270 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.528248    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.623853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.623812    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 21:45:53.623853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.623844    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 21:45:53.624097 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.623870    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-x4h9p\""
Oct 30 21:45:53.624478 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.624460    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"]
Oct 30 21:45:53.624848 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.624833    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"]
Oct 30 21:45:53.628298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.628278    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.630708 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.630683    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cg22\" (UniqueName: \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.630830 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.630728    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.630893 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.630868    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.676749 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.676715    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-pmn49\""
Oct 30 21:45:53.705987 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.705949    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"]
Oct 30 21:45:53.731354 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731322    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"]
Oct 30 21:45:53.731555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731416    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cg22\" (UniqueName: \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.731555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731459    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.731699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731606    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcblx\" (UniqueName: \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.731762 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731706    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.731821 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731769    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.731821 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731802    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.731924 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731880    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.732011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.731995    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.734679 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.734660    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.783132 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.783051    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-ckqc6\""
Oct 30 21:45:53.785235 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.785212    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cg22\" (UniqueName: \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.793665 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.793639    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"]
Oct 30 21:45:53.824621 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.824587    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"]
Oct 30 21:45:53.828065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.828036    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:53.833025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.832997    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.833177 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833085    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.833177 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833131    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.833295 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833172    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dsqs\" (UniqueName: \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.833295 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833231    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.833295 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833256    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcblx\" (UniqueName: \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.833502 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833482    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.833571 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.833517    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.844589 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.844565    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:45:53.885555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.884333    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-5cpn4\""
Oct 30 21:45:53.887977 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.887809    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcblx\" (UniqueName: \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.889736 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.889708    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"]
Oct 30 21:45:53.935006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.934742    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.935006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.934807    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dsqs\" (UniqueName: \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.935006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.934846    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:53.935006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.934884    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.936218 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.936181    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.936490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.936467    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:53.936623 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.934921    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9h6t\" (UniqueName: \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:53.936623 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.936611    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:53.944145 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.944115    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:45:53.996900 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:53.996869    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dsqs\" (UniqueName: \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:54.037884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.037795    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.037884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.037867    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9h6t\" (UniqueName: \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.038150 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.037897    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.038213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.038193    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.038303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.038283    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.049682 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.049650    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:45:54.064328 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.064297    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"]
Oct 30 21:45:54.068554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.068527    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.091642 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.091606    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9h6t\" (UniqueName: \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.117558 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.117524    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-7cqm9\""
Oct 30 21:45:54.127337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.127307    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"]
Oct 30 21:45:54.138847 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.138816    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.138847 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.138854    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.139058 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.138878    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4nl\" (UniqueName: \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.145834 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.145806    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:45:54.239750 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.239711    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.239950 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.239761    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.239950 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.239787    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4nl\" (UniqueName: \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.240167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.240146    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.240204 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.240176    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.273270 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.273236    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"]
Oct 30 21:45:54.280227 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:54.280200    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf03a8b7_d16f_42ed_a6d6_4a11a9c0b440.slice/crio-04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75 WatchSource:0}: Error finding container 04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75: Status 404 returned error can't find the container with id 04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75
Oct 30 21:45:54.282191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.282170    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:45:54.293503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.293439    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4nl\" (UniqueName: \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.326976 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.326945    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"]
Oct 30 21:45:54.334545 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:54.334515    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b92127c_5bdd_4eba_b702_e763b0982b64.slice/crio-54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0 WatchSource:0}: Error finding container 54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0: Status 404 returned error can't find the container with id 54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0
Oct 30 21:45:54.385580 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.385543    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:45:54.416019 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.415987    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"]
Oct 30 21:45:54.423383 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:54.423344    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95ca2d6_5dc2_4b41_8ba1_1bc7eefac919.slice/crio-4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a WatchSource:0}: Error finding container 4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a: Status 404 returned error can't find the container with id 4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a
Oct 30 21:45:54.515545 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.515508    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"]
Oct 30 21:45:54.522295 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:54.522268    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcefd3f5_fcb7_4b45_83dd_3bf5e890e609.slice/crio-2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255 WatchSource:0}: Error finding container 2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255: Status 404 returned error can't find the container with id 2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255
Oct 30 21:45:54.750639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.750608    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"]
Oct 30 21:45:54.757525 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:54.757502    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db47b25_f6e9_4802_a4ff_3b653753a8e2.slice/crio-ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7 WatchSource:0}: Error finding container ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7: Status 404 returned error can't find the container with id ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7
Oct 30 21:45:54.764606 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.764579    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerStarted","Data":"4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a"}
Oct 30 21:45:54.765692 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.765673    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf" event={"ID":"4b92127c-5bdd-4eba-b702-e763b0982b64","Type":"ContainerStarted","Data":"54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0"}
Oct 30 21:45:54.766773 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.766752    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerStarted","Data":"2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255"}
Oct 30 21:45:54.767714 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.767696    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerStarted","Data":"ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7"}
Oct 30 21:45:54.768598 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:54.768580    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47" event={"ID":"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440","Type":"ContainerStarted","Data":"04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75"}
Oct 30 21:45:55.553273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.553230    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"]
Oct 30 21:45:55.557808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.557732    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.607340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.607307    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-s4mkc\""
Oct 30 21:45:55.618618 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.618565    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"]
Oct 30 21:45:55.652215 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.652180    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.652409 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.652257    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48w5j\" (UniqueName: \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.652479 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.652405    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.754335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.753147    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48w5j\" (UniqueName: \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.754335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.753218    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.754335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.753280    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.754335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.753716    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.754335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.754240    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.814201 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.814089    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48w5j\" (UniqueName: \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:55.878227 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:55.878187    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:45:56.286681 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:56.286641    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"]
Oct 30 21:45:56.300323 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:56.300294    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb811ce_dc00_4867_9177_0a81f1cf4616.slice/crio-fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0 WatchSource:0}: Error finding container fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0: Status 404 returned error can't find the container with id fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0
Oct 30 21:45:56.782445 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:56.782379    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerStarted","Data":"fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0"}
Oct 30 21:45:58.373808 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.373769    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"]
Oct 30 21:45:58.379265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.378536    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.428709 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.428611    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-hvkqs\""
Oct 30 21:45:58.475737 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.475650    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"]
Oct 30 21:45:58.481439 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.481186    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.481439 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.481236    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.481439 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.481297    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rtq\" (UniqueName: \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.583265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.582560    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rtq\" (UniqueName: \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.583265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.582669    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.583265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.582703    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.583265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.583158    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.583629 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.583328    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.644962 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.638151    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rtq\" (UniqueName: \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:58.703267 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:58.702922    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:45:59.135218 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:59.135048    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"]
Oct 30 21:45:59.144840 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:45:59.144806    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664af3c5_3c9d_41ea_bc6f_ffe8e596cdcc.slice/crio-1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18 WatchSource:0}: Error finding container 1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18: Status 404 returned error can't find the container with id 1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18
Oct 30 21:45:59.801517 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:45:59.801381    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerStarted","Data":"1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18"}
Oct 30 21:46:00.645725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.645687    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"]
Oct 30 21:46:00.649868 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.649841    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.670630 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.670269    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"]
Oct 30 21:46:00.675764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.675729    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.703171 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703141    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.703171 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703175    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.703492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703198    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtk85\" (UniqueName: \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.703492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703229    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.703492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703266    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6prq\" (UniqueName: \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.703492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.703288    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.718962 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.717768    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"]
Oct 30 21:46:00.725822 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.725788    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"]
Oct 30 21:46:00.726019 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.725966    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.748669 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.748640    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"]
Oct 30 21:46:00.765909 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.765877    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"]
Oct 30 21:46:00.803869 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.803834    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.803880    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.803922    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pplzk\" (UniqueName: \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.803978    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtk85\" (UniqueName: \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804030    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804060    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804100    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6prq\" (UniqueName: \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804130    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804163    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.804298 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804283    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.804764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804525    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.804764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.804664    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.805236 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.805097    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.868726 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.868661    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6prq\" (UniqueName: \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.869586 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.869557    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtk85\" (UniqueName: \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:00.906387 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.905668    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pplzk\" (UniqueName: \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.906387 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.905752    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.906387 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.905795    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.906387 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.906272    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.906711 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.906430    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.965213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.965176    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pplzk\" (UniqueName: \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:00.972862 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.972832    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:00.998331 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:00.998131    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:01.063265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.063231    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:01.482784 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.482704    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"]
Oct 30 21:46:01.491431 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:46:01.491397    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb375421e_7202_45d5_84e4_d8b1a6427421.slice/crio-e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0 WatchSource:0}: Error finding container e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0: Status 404 returned error can't find the container with id e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0
Oct 30 21:46:01.494566 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.494538    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"]
Oct 30 21:46:01.506814 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:46:01.506786    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07691439_8e5c_4269_9502_09c582ea2c3d.slice/crio-a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310 WatchSource:0}: Error finding container a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310: Status 404 returned error can't find the container with id a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310
Oct 30 21:46:01.533173 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.533042    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"]
Oct 30 21:46:01.819112 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.818979    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx" event={"ID":"07691439-8e5c-4269-9502-09c582ea2c3d","Type":"ContainerStarted","Data":"a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310"}
Oct 30 21:46:01.822256 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.822201    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerStarted","Data":"ef1b2cf3f83213e09d28d724e4bcc9598ee7e85336592414de4b1ab7610c8a25"}
Oct 30 21:46:01.827118 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:01.827084    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerStarted","Data":"e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0"}
Oct 30 21:46:11.924852 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:11.924623    5579 generic.go:356] "Generic (PLEG): container finished" podID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerID="e4b2e59a7a431c3461dabcf7c6421bdcacd432f160defe5f7c7ca18a98069e14" exitCode=0
Oct 30 21:46:11.924852 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:11.924783    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerDied","Data":"e4b2e59a7a431c3461dabcf7c6421bdcacd432f160defe5f7c7ca18a98069e14"}
Oct 30 21:46:11.929205 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:11.929175    5579 generic.go:356] "Generic (PLEG): container finished" podID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerID="9f9b5bf5a8ad5bcc9bfd0ce15897bf3d02d75c6c7cbc31f47f15e3564471d867" exitCode=0
Oct 30 21:46:11.929306 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:11.929259    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47" event={"ID":"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440","Type":"ContainerDied","Data":"9f9b5bf5a8ad5bcc9bfd0ce15897bf3d02d75c6c7cbc31f47f15e3564471d867"}
Oct 30 21:46:12.936023 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:46:12.935986    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:46:12.936527 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.936167    5579 generic.go:356] "Generic (PLEG): container finished" podID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerID="746bc40b3baef7a6e0ab208b5f15c060b2139674bb411cfdfc9afc8dae5ccbbb" exitCode=0
Oct 30 21:46:12.936527 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.936226    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf" event={"ID":"4b92127c-5bdd-4eba-b702-e763b0982b64","Type":"ContainerDied","Data":"746bc40b3baef7a6e0ab208b5f15c060b2139674bb411cfdfc9afc8dae5ccbbb"}
Oct 30 21:46:12.939214 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.939185    5579 generic.go:356] "Generic (PLEG): container finished" podID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerID="4ef3ff43f8d94d758ae6f0363348a2f38d1377e424253f5c65596d744d0929e4" exitCode=0
Oct 30 21:46:12.939345 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.939275    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerDied","Data":"4ef3ff43f8d94d758ae6f0363348a2f38d1377e424253f5c65596d744d0929e4"}
Oct 30 21:46:12.942424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.941641    5579 generic.go:356] "Generic (PLEG): container finished" podID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerID="62c9eccafed33b48787c1daa305892dc2be02768a5a9249cae7cbb832aecae37" exitCode=0
Oct 30 21:46:12.942424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:12.941743    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerDied","Data":"62c9eccafed33b48787c1daa305892dc2be02768a5a9249cae7cbb832aecae37"}
Oct 30 21:46:13.947832 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.947790    5579 generic.go:356] "Generic (PLEG): container finished" podID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerID="08617d1a4db0a313d8ca86b0e091aa49000110c8b55ef5473f90dba279a0b61b" exitCode=0
Oct 30 21:46:13.948305 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.947873    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerDied","Data":"08617d1a4db0a313d8ca86b0e091aa49000110c8b55ef5473f90dba279a0b61b"}
Oct 30 21:46:13.950065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.950039    5579 generic.go:356] "Generic (PLEG): container finished" podID="07691439-8e5c-4269-9502-09c582ea2c3d" containerID="a45dc94c22fb5b0de20697e39aa6cd7daf30aeec2442a769c19551e9b121a47c" exitCode=0
Oct 30 21:46:13.950198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.950121    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx" event={"ID":"07691439-8e5c-4269-9502-09c582ea2c3d","Type":"ContainerDied","Data":"a45dc94c22fb5b0de20697e39aa6cd7daf30aeec2442a769c19551e9b121a47c"}
Oct 30 21:46:13.951766 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.951737    5579 generic.go:356] "Generic (PLEG): container finished" podID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerID="aeaa30e46bfd0959f2367f85a0012c73741d11f800579748c04c00d469a01fa5" exitCode=0
Oct 30 21:46:13.951896 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.951837    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerDied","Data":"aeaa30e46bfd0959f2367f85a0012c73741d11f800579748c04c00d469a01fa5"}
Oct 30 21:46:13.954034 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.954008    5579 generic.go:356] "Generic (PLEG): container finished" podID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerID="86cfc8b992ae8d39e8ee21e7dfd994a75525c890228288903d1a8a02c2a66afd" exitCode=0
Oct 30 21:46:13.954144 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.954090    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47" event={"ID":"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440","Type":"ContainerDied","Data":"86cfc8b992ae8d39e8ee21e7dfd994a75525c890228288903d1a8a02c2a66afd"}
Oct 30 21:46:13.955701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.955680    5579 generic.go:356] "Generic (PLEG): container finished" podID="b375421e-7202-45d5-84e4-d8b1a6427421" containerID="d9e5099d0f24e93f3d1591a0fb143e4b0f1010e04310f099e71691a8955528c3" exitCode=0
Oct 30 21:46:13.955780 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.955757    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerDied","Data":"d9e5099d0f24e93f3d1591a0fb143e4b0f1010e04310f099e71691a8955528c3"}
Oct 30 21:46:13.957631 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.957611    5579 generic.go:356] "Generic (PLEG): container finished" podID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerID="07869ac24a74166a986ff445b3c3a80a52e9a10aea971ce407b9b4b33a1d7823" exitCode=0
Oct 30 21:46:13.957749 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:13.957672    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerDied","Data":"07869ac24a74166a986ff445b3c3a80a52e9a10aea971ce407b9b4b33a1d7823"}
Oct 30 21:46:14.963243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.963166    5579 generic.go:356] "Generic (PLEG): container finished" podID="b375421e-7202-45d5-84e4-d8b1a6427421" containerID="e0ba80729b5c01d6d4a2158dcb722718b890963ae6886d58833d5a9854277589" exitCode=0
Oct 30 21:46:14.963870 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.963252    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerDied","Data":"e0ba80729b5c01d6d4a2158dcb722718b890963ae6886d58833d5a9854277589"}
Oct 30 21:46:14.965223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.965172    5579 generic.go:356] "Generic (PLEG): container finished" podID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerID="39549be295fe10161f192caa6f5b988d477732439096f61438849c3280c9bba5" exitCode=0
Oct 30 21:46:14.965223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.965204    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerDied","Data":"39549be295fe10161f192caa6f5b988d477732439096f61438849c3280c9bba5"}
Oct 30 21:46:14.966955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.966869    5579 generic.go:356] "Generic (PLEG): container finished" podID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerID="d5767ba3d67ccfa215f553013f2fbdb7f7c6fe281ce11c3aa8911647ee6afdb3" exitCode=0
Oct 30 21:46:14.966955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:14.966900    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerDied","Data":"d5767ba3d67ccfa215f553013f2fbdb7f7c6fe281ce11c3aa8911647ee6afdb3"}
Oct 30 21:46:15.978511 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.978470    5579 generic.go:356] "Generic (PLEG): container finished" podID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerID="72d36e5df15733ea30e81c1256431336859a79233be4c5345ed4418d73d0623f" exitCode=0
Oct 30 21:46:15.979018 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.978583    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf" event={"ID":"4b92127c-5bdd-4eba-b702-e763b0982b64","Type":"ContainerDied","Data":"72d36e5df15733ea30e81c1256431336859a79233be4c5345ed4418d73d0623f"}
Oct 30 21:46:15.982664 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.982601    5579 generic.go:356] "Generic (PLEG): container finished" podID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerID="4d323c796962e67183a1d40e7b425019ec36907e030ecd2137583e2836be75b2" exitCode=0
Oct 30 21:46:15.982774 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.982680    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerDied","Data":"4d323c796962e67183a1d40e7b425019ec36907e030ecd2137583e2836be75b2"}
Oct 30 21:46:15.986975 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.986846    5579 generic.go:356] "Generic (PLEG): container finished" podID="07691439-8e5c-4269-9502-09c582ea2c3d" containerID="3435177a25c8b3a9db8a715bf1d9366d44156a9d0520b3e8be3d645da9f780cf" exitCode=0
Oct 30 21:46:15.986975 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.986916    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx" event={"ID":"07691439-8e5c-4269-9502-09c582ea2c3d","Type":"ContainerDied","Data":"3435177a25c8b3a9db8a715bf1d9366d44156a9d0520b3e8be3d645da9f780cf"}
Oct 30 21:46:15.990696 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.990169    5579 generic.go:356] "Generic (PLEG): container finished" podID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerID="5f9381e243080a7c0372b1130da446830e9c3bea1f8ef9f2d3d57cd7ea60abae" exitCode=0
Oct 30 21:46:15.990696 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:15.990311    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerDied","Data":"5f9381e243080a7c0372b1130da446830e9c3bea1f8ef9f2d3d57cd7ea60abae"}
Oct 30 21:46:22.075397 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:22.075353    5579 generic.go:356] "Generic (PLEG): container finished" podID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerID="665a0598f78fe831a9ac090daa4c669ad6332a9f7b34583c249557244f1c9bba" exitCode=0
Oct 30 21:46:22.076047 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:22.075450    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerDied","Data":"665a0598f78fe831a9ac090daa4c669ad6332a9f7b34583c249557244f1c9bba"}
Oct 30 21:46:23.102817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:23.101858    5579 generic.go:356] "Generic (PLEG): container finished" podID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerID="0893f84e484302cd8699fd0b27e10fdabf2d3b51df3056e2dda5027019fb3250" exitCode=0
Oct 30 21:46:23.102817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:23.101906    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerDied","Data":"0893f84e484302cd8699fd0b27e10fdabf2d3b51df3056e2dda5027019fb3250"}
Oct 30 21:46:34.227630 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:34.227586    5579 generic.go:356] "Generic (PLEG): container finished" podID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerID="43445620d517f94282e0b8a3044a428c56ff86e74825ca132c5382539eaac16d" exitCode=0
Oct 30 21:46:34.228171 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:34.227727    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47" event={"ID":"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440","Type":"ContainerDied","Data":"43445620d517f94282e0b8a3044a428c56ff86e74825ca132c5382539eaac16d"}
Oct 30 21:46:34.241665 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:34.236876    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerStarted","Data":"a078107113df36b7131cb9ac7a0abc96076d4303f75d01f9f67be7b7da77726d"}
Oct 30 21:46:34.484531 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:34.484316    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" podStartSLOduration=2.37968352 podStartE2EDuration="41.484296342s" totalImagesPullingTime="39.104612822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:34.482519431 +0000 UTC m=+199.452365843" watchObservedRunningTime="2026-10-30 21:46:34.484296342 +0000 UTC m=+199.454142754"
Oct 30 21:46:35.251467 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.251381    5579 generic.go:356] "Generic (PLEG): container finished" podID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerID="a078107113df36b7131cb9ac7a0abc96076d4303f75d01f9f67be7b7da77726d" exitCode=0
Oct 30 21:46:35.251981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.251507    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerDied","Data":"a078107113df36b7131cb9ac7a0abc96076d4303f75d01f9f67be7b7da77726d"}
Oct 30 21:46:35.259068 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.259002    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerStarted","Data":"1b371388e2d81ef997ea43798e0103d6035df2ca9696bbc04efedd3c4e82b1d6"}
Oct 30 21:46:35.458797 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.458756    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:46:35.486424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.485674    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\") pod \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") "
Oct 30 21:46:35.486424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.485743    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\" (UniqueName: \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\") pod \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") "
Oct 30 21:46:35.486424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.485882    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\") pod \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\" (UID: \"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440\") "
Oct 30 21:46:35.487634 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.487586    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle" pod "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" (UID: "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:35.489514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.489481    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22" pod "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" (UID: "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440"). InnerVolumeSpecName "kube-api-access-8cg22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:35.494389 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.494353    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util" pod "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" (UID: "bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:35.588801 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.586640    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:35.588801 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.586677    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:35.588801 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:35.586692    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cg22\" (UniqueName: \"kubernetes.io/projected/bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440-kube-api-access-8cg22\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.269819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.269780    5579 generic.go:356] "Generic (PLEG): container finished" podID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerID="1b371388e2d81ef997ea43798e0103d6035df2ca9696bbc04efedd3c4e82b1d6" exitCode=0
Oct 30 21:46:36.270265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.269889    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerDied","Data":"1b371388e2d81ef997ea43798e0103d6035df2ca9696bbc04efedd3c4e82b1d6"}
Oct 30 21:46:36.274594 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.274560    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerStarted","Data":"e357d1e61eb6e4d156b04b327c57ef8e0980973951dedc9354acf7d2cf6a08f3"}
Oct 30 21:46:36.280503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.280471    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerStarted","Data":"2fd2447378cb08c8320d2edf3077d9657894fd0805a5e291af607d4a0d957618"}
Oct 30 21:46:36.289154 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.289121    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47" event={"ID":"bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440","Type":"ContainerDied","Data":"04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75"}
Oct 30 21:46:36.289303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.289186    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04352d43498615f166fa05c06acb3db62bb369046ae825fc46c162667109fc75"
Oct 30 21:46:36.289303 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.289205    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c6pv47"
Oct 30 21:46:36.293377 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.293347    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerStarted","Data":"806569ba7df01bce8b15a2fc231d163113d6a8c399528a87378ef2eef5ef1be8"}
Oct 30 21:46:36.465211 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.465178    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:46:36.494838 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.494810    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\") pod \"1eb811ce-dc00-4867-9177-0a81f1cf4616\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") "
Oct 30 21:46:36.495004 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.494948    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\") pod \"1eb811ce-dc00-4867-9177-0a81f1cf4616\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") "
Oct 30 21:46:36.495048 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.495015    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\" (UniqueName: \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\") pod \"1eb811ce-dc00-4867-9177-0a81f1cf4616\" (UID: \"1eb811ce-dc00-4867-9177-0a81f1cf4616\") "
Oct 30 21:46:36.495372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.495342    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle" pod "1eb811ce-dc00-4867-9177-0a81f1cf4616" (UID: "1eb811ce-dc00-4867-9177-0a81f1cf4616"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:36.502620 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.502589    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util" pod "1eb811ce-dc00-4867-9177-0a81f1cf4616" (UID: "1eb811ce-dc00-4867-9177-0a81f1cf4616"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:36.504250 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.504156    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:46:36.506384 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.506360    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j" pod "1eb811ce-dc00-4867-9177-0a81f1cf4616" (UID: "1eb811ce-dc00-4867-9177-0a81f1cf4616"). InnerVolumeSpecName "kube-api-access-48w5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:36.507058 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.507007    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" podStartSLOduration=3.025049264 podStartE2EDuration="42.506990345s" totalImagesPullingTime="39.481941081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:36.390834267 +0000 UTC m=+201.360680678" watchObservedRunningTime="2026-10-30 21:46:36.506990345 +0000 UTC m=+201.476836755"
Oct 30 21:46:36.507167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.507142    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" podStartSLOduration=3.152864369 podStartE2EDuration="38.507133751s" totalImagesPullingTime="35.354269382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:36.505397871 +0000 UTC m=+201.475244282" watchObservedRunningTime="2026-10-30 21:46:36.507133751 +0000 UTC m=+201.476980161"
Oct 30 21:46:36.596171 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596133    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\" (UniqueName: \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\") pod \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") "
Oct 30 21:46:36.596339 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596218    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\") pod \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") "
Oct 30 21:46:36.596339 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596269    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\") pod \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\" (UID: \"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919\") "
Oct 30 21:46:36.596492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596476    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.596541 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596499    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48w5j\" (UniqueName: \"kubernetes.io/projected/1eb811ce-dc00-4867-9177-0a81f1cf4616-kube-api-access-48w5j\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.596541 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596512    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb811ce-dc00-4867-9177-0a81f1cf4616-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.596820 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.596788    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle" pod "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" (UID: "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:36.598378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.598348    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs" pod "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" (UID: "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919"). InnerVolumeSpecName "kube-api-access-2dsqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:36.601738 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.601706    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util" pod "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" (UID: "d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:36.617144 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.617100    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" podStartSLOduration=4.074246055 podStartE2EDuration="36.617086591s" totalImagesPullingTime="32.542840536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:36.616386957 +0000 UTC m=+201.586233365" watchObservedRunningTime="2026-10-30 21:46:36.617086591 +0000 UTC m=+201.586933078"
Oct 30 21:46:36.697747 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.697711    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dsqs\" (UniqueName: \"kubernetes.io/projected/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-kube-api-access-2dsqs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.697747 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.697743    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:36.697747 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:36.697753    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:37.299179 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.299154    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk"
Oct 30 21:46:37.299179 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.299165    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l4mlk" event={"ID":"d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919","Type":"ContainerDied","Data":"4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a"}
Oct 30 21:46:37.299568 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.299219    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a4eec006ca32847951b475de9784c74194eb51e8c868398ea37fe630159b80a"
Oct 30 21:46:37.301402 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.301379    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerStarted","Data":"36d91dc53ddd83b3bde45012f21d85931a38807eeb7524ff664b9e5235600a0b"}
Oct 30 21:46:37.303426 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.303406    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt"
Oct 30 21:46:37.303537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.303429    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tgxlt" event={"ID":"1eb811ce-dc00-4867-9177-0a81f1cf4616","Type":"ContainerDied","Data":"fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0"}
Oct 30 21:46:37.303537 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.303464    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fba0c19e7b7e8ba351a5fc9fb4b899f1325278789b069466620de36d7ca0e6e0"
Oct 30 21:46:37.306077 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.306045    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerStarted","Data":"59f4473a1bbe9ff5509816a4afdf1b3d36a0d14f801d192abf5984778627c255"}
Oct 30 21:46:37.308116 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.308095    5579 generic.go:356] "Generic (PLEG): container finished" podID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerID="e357d1e61eb6e4d156b04b327c57ef8e0980973951dedc9354acf7d2cf6a08f3" exitCode=0
Oct 30 21:46:37.308214 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.308161    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerDied","Data":"e357d1e61eb6e4d156b04b327c57ef8e0980973951dedc9354acf7d2cf6a08f3"}
Oct 30 21:46:37.310152 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.310129    5579 generic.go:356] "Generic (PLEG): container finished" podID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerID="2fd2447378cb08c8320d2edf3077d9657894fd0805a5e291af607d4a0d957618" exitCode=0
Oct 30 21:46:37.310243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.310220    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerDied","Data":"2fd2447378cb08c8320d2edf3077d9657894fd0805a5e291af607d4a0d957618"}
Oct 30 21:46:37.312094 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.312075    5579 generic.go:356] "Generic (PLEG): container finished" podID="b375421e-7202-45d5-84e4-d8b1a6427421" containerID="806569ba7df01bce8b15a2fc231d163113d6a8c399528a87378ef2eef5ef1be8" exitCode=0
Oct 30 21:46:37.312190 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.312115    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerDied","Data":"806569ba7df01bce8b15a2fc231d163113d6a8c399528a87378ef2eef5ef1be8"}
Oct 30 21:46:37.411503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.411396    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" podStartSLOduration=3.303879045 podStartE2EDuration="44.411383297s" totalImagesPullingTime="41.107504252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:37.410816901 +0000 UTC m=+202.380663309" watchObservedRunningTime="2026-10-30 21:46:37.411383297 +0000 UTC m=+202.381229703"
Oct 30 21:46:37.680535 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:37.680407    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" podStartSLOduration=3.667838279 podStartE2EDuration="37.680393398s" totalImagesPullingTime="34.012555119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:37.680053303 +0000 UTC m=+202.649899712" watchObservedRunningTime="2026-10-30 21:46:37.680393398 +0000 UTC m=+202.650239808"
Oct 30 21:46:38.318170 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.318079    5579 generic.go:356] "Generic (PLEG): container finished" podID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerID="f5da8ed0d52750646516b021440319a6a4b8e70dbb182ee1674c2a913c14c91f" exitCode=0
Oct 30 21:46:38.318543 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.318162    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf" event={"ID":"4b92127c-5bdd-4eba-b702-e763b0982b64","Type":"ContainerDied","Data":"f5da8ed0d52750646516b021440319a6a4b8e70dbb182ee1674c2a913c14c91f"}
Oct 30 21:46:38.320281 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.320257    5579 generic.go:356] "Generic (PLEG): container finished" podID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerID="36d91dc53ddd83b3bde45012f21d85931a38807eeb7524ff664b9e5235600a0b" exitCode=0
Oct 30 21:46:38.320413 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.320335    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerDied","Data":"36d91dc53ddd83b3bde45012f21d85931a38807eeb7524ff664b9e5235600a0b"}
Oct 30 21:46:38.322209 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.322189    5579 generic.go:356] "Generic (PLEG): container finished" podID="07691439-8e5c-4269-9502-09c582ea2c3d" containerID="ccc8b9d8b5efb0d9592f94993e4b339f5615fdc82731a01bae5ec7f31d2c2aba" exitCode=0
Oct 30 21:46:38.322326 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.322262    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx" event={"ID":"07691439-8e5c-4269-9502-09c582ea2c3d","Type":"ContainerDied","Data":"ccc8b9d8b5efb0d9592f94993e4b339f5615fdc82731a01bae5ec7f31d2c2aba"}
Oct 30 21:46:38.324100 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.324076    5579 generic.go:356] "Generic (PLEG): container finished" podID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerID="59f4473a1bbe9ff5509816a4afdf1b3d36a0d14f801d192abf5984778627c255" exitCode=0
Oct 30 21:46:38.324185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.324167    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerDied","Data":"59f4473a1bbe9ff5509816a4afdf1b3d36a0d14f801d192abf5984778627c255"}
Oct 30 21:46:38.460166 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.460140    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:46:38.486443 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.486421    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:46:38.489799 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.489779    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:38.512239 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512217    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\") pod \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") "
Oct 30 21:46:38.512342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512254    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\" (UniqueName: \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\") pod \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") "
Oct 30 21:46:38.512342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512298    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\") pod \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\" (UID: \"8db47b25-f6e9-4802-a4ff-3b653753a8e2\") "
Oct 30 21:46:38.512342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512329    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\" (UniqueName: \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\") pod \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") "
Oct 30 21:46:38.512471 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512389    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\") pod \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") "
Oct 30 21:46:38.512471 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512414    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\") pod \"b375421e-7202-45d5-84e4-d8b1a6427421\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") "
Oct 30 21:46:38.512576 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512468    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\") pod \"b375421e-7202-45d5-84e4-d8b1a6427421\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") "
Oct 30 21:46:38.513042 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.513014    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle" pod "8db47b25-f6e9-4802-a4ff-3b653753a8e2" (UID: "8db47b25-f6e9-4802-a4ff-3b653753a8e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.513188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.512524    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\" (UniqueName: \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\") pod \"b375421e-7202-45d5-84e4-d8b1a6427421\" (UID: \"b375421e-7202-45d5-84e4-d8b1a6427421\") "
Oct 30 21:46:38.513188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.513012    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle" pod "b375421e-7202-45d5-84e4-d8b1a6427421" (UID: "b375421e-7202-45d5-84e4-d8b1a6427421"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.513188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.513128    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\") pod \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\" (UID: \"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc\") "
Oct 30 21:46:38.514402 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514372    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle" pod "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" (UID: "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.514680 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514658    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.514680 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514680    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.514821 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514694    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.514821 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514781    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl" pod "8db47b25-f6e9-4802-a4ff-3b653753a8e2" (UID: "8db47b25-f6e9-4802-a4ff-3b653753a8e2"). InnerVolumeSpecName "kube-api-access-nk4nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:38.514908 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.514884    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq" pod "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" (UID: "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc"). InnerVolumeSpecName "kube-api-access-55rtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:38.515390 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.515366    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85" pod "b375421e-7202-45d5-84e4-d8b1a6427421" (UID: "b375421e-7202-45d5-84e4-d8b1a6427421"). InnerVolumeSpecName "kube-api-access-mtk85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:38.520689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.520664    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util" pod "8db47b25-f6e9-4802-a4ff-3b653753a8e2" (UID: "8db47b25-f6e9-4802-a4ff-3b653753a8e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.520869 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.520849    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util" pod "b375421e-7202-45d5-84e4-d8b1a6427421" (UID: "b375421e-7202-45d5-84e4-d8b1a6427421"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.522092 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.522073    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util" pod "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" (UID: "664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615056    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk4nl\" (UniqueName: \"kubernetes.io/projected/8db47b25-f6e9-4802-a4ff-3b653753a8e2-kube-api-access-nk4nl\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615083    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db47b25-f6e9-4802-a4ff-3b653753a8e2-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615092    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55rtq\" (UniqueName: \"kubernetes.io/projected/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-kube-api-access-55rtq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615101    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615109    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b375421e-7202-45d5-84e4-d8b1a6427421-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:38.615129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:38.615117    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtk85\" (UniqueName: \"kubernetes.io/projected/b375421e-7202-45d5-84e4-d8b1a6427421-kube-api-access-mtk85\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.330503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.330460    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt" event={"ID":"8db47b25-f6e9-4802-a4ff-3b653753a8e2","Type":"ContainerDied","Data":"ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7"}
Oct 30 21:46:39.331020 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.330544    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef318b90e833cdd906c8474adeaea5d65e4533abddbfad5dc8bc2d240b5c1fb7"
Oct 30 21:46:39.331020 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.330488    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be714b6kt"
Oct 30 21:46:39.332611 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.332576    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786" event={"ID":"664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc","Type":"ContainerDied","Data":"1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18"}
Oct 30 21:46:39.332748 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.332622    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1025fbff84a0179c9693ea627c581f7690fbdc296fe25260e84e36498e5fcd18"
Oct 30 21:46:39.332748 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.332585    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651csl786"
Oct 30 21:46:39.334695 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.334656    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx" event={"ID":"b375421e-7202-45d5-84e4-d8b1a6427421","Type":"ContainerDied","Data":"e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0"}
Oct 30 21:46:39.334798 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.334711    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4bf936a8470532b1366a7a95e7c9a6de25217dc3b41a3e248b2dd500a30c9f0"
Oct 30 21:46:39.335659 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.335252    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mj7cx"
Oct 30 21:46:39.470607 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.470583    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:46:39.520738 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.520716    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:39.521737 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.521713    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\") pod \"4b92127c-5bdd-4eba-b702-e763b0982b64\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") "
Oct 30 21:46:39.521853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.521806    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\" (UniqueName: \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\") pod \"4b92127c-5bdd-4eba-b702-e763b0982b64\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") "
Oct 30 21:46:39.521920 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.521872    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\") pod \"4b92127c-5bdd-4eba-b702-e763b0982b64\" (UID: \"4b92127c-5bdd-4eba-b702-e763b0982b64\") "
Oct 30 21:46:39.522211 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.522185    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle" pod "4b92127c-5bdd-4eba-b702-e763b0982b64" (UID: "4b92127c-5bdd-4eba-b702-e763b0982b64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.523976 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.523956    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:46:39.524097 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.524073    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx" pod "4b92127c-5bdd-4eba-b702-e763b0982b64" (UID: "4b92127c-5bdd-4eba-b702-e763b0982b64"). InnerVolumeSpecName "kube-api-access-xcblx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:39.527746 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.527728    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:39.528598 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.528577    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util" pod "4b92127c-5bdd-4eba-b702-e763b0982b64" (UID: "4b92127c-5bdd-4eba-b702-e763b0982b64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.622825 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.622793    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\" (UniqueName: \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\") pod \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") "
Oct 30 21:46:39.623025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.622842    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\") pod \"07691439-8e5c-4269-9502-09c582ea2c3d\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") "
Oct 30 21:46:39.623025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.622869    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\") pod \"07691439-8e5c-4269-9502-09c582ea2c3d\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") "
Oct 30 21:46:39.623025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.622910    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\") pod \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") "
Oct 30 21:46:39.623025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.622981    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\") pod \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") "
Oct 30 21:46:39.623025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623022    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\") pod \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\" (UID: \"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609\") "
Oct 30 21:46:39.623294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623082    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\" (UniqueName: \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\") pod \"07691439-8e5c-4269-9502-09c582ea2c3d\" (UID: \"07691439-8e5c-4269-9502-09c582ea2c3d\") "
Oct 30 21:46:39.623294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623135    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\" (UniqueName: \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\") pod \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") "
Oct 30 21:46:39.623294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623172    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\") pod \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\" (UID: \"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a\") "
Oct 30 21:46:39.623444 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623418    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcblx\" (UniqueName: \"kubernetes.io/projected/4b92127c-5bdd-4eba-b702-e763b0982b64-kube-api-access-xcblx\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.623444 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623435    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.623548 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623448    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b92127c-5bdd-4eba-b702-e763b0982b64-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.623982 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.623949    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle" pod "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" (UID: "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.624149 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.624120    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle" pod "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" (UID: "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.625079 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.625051    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle" pod "07691439-8e5c-4269-9502-09c582ea2c3d" (UID: "07691439-8e5c-4269-9502-09c582ea2c3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.625593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.625565    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk" pod "07691439-8e5c-4269-9502-09c582ea2c3d" (UID: "07691439-8e5c-4269-9502-09c582ea2c3d"). InnerVolumeSpecName "kube-api-access-pplzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:39.625698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.625603    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t" pod "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" (UID: "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609"). InnerVolumeSpecName "kube-api-access-v9h6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:39.626302 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.626278    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq" pod "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" (UID: "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a"). InnerVolumeSpecName "kube-api-access-x6prq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:39.630200 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.630179    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util" pod "07691439-8e5c-4269-9502-09c582ea2c3d" (UID: "07691439-8e5c-4269-9502-09c582ea2c3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.630568 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.630546    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util" pod "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" (UID: "dcefd3f5-fcb7-4b45-83dd-3bf5e890e609"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.630718 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.630700    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util" pod "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" (UID: "44e1fd54-b2b0-48eb-a61d-2fe991f2c46a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:39.724966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724875    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.724966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724914    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.724966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724945    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.724966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724961    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pplzk\" (UniqueName: \"kubernetes.io/projected/07691439-8e5c-4269-9502-09c582ea2c3d-kube-api-access-pplzk\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.725198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724978    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6prq\" (UniqueName: \"kubernetes.io/projected/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-kube-api-access-x6prq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.725198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.724992    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44e1fd54-b2b0-48eb-a61d-2fe991f2c46a-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.725198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.725007    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9h6t\" (UniqueName: \"kubernetes.io/projected/dcefd3f5-fcb7-4b45-83dd-3bf5e890e609-kube-api-access-v9h6t\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.725198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.725020    5579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-bundle\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:39.725198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:39.725034    5579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07691439-8e5c-4269-9502-09c582ea2c3d-util\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:46:40.340394 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.340362    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf"
Oct 30 21:46:40.340846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.340359    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c625fjf" event={"ID":"4b92127c-5bdd-4eba-b702-e763b0982b64","Type":"ContainerDied","Data":"54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0"}
Oct 30 21:46:40.340846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.340484    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54933f3eeb82834b19e7c8a72ebae9ecbbfae391488243642a0b180143ffb7a0"
Oct 30 21:46:40.342318 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.342297    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl"
Oct 30 21:46:40.342459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.342321    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad6wbl" event={"ID":"dcefd3f5-fcb7-4b45-83dd-3bf5e890e609","Type":"ContainerDied","Data":"2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255"}
Oct 30 21:46:40.342459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.342372    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a3eb243deb82a508cfde15cd96cb90178eeca8dbdeaf46bb95994be2a873255"
Oct 30 21:46:40.344340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.344317    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx"
Oct 30 21:46:40.344340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.344330    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apq6hx" event={"ID":"07691439-8e5c-4269-9502-09c582ea2c3d","Type":"ContainerDied","Data":"a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310"}
Oct 30 21:46:40.344514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.344367    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a182e5e14d082724b98eea3148db7feb7caf7c86b4abce980d0ba6dca05da310"
Oct 30 21:46:40.346476 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.346458    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m"
Oct 30 21:46:40.346556 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.346454    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f6h5m" event={"ID":"44e1fd54-b2b0-48eb-a61d-2fe991f2c46a","Type":"ContainerDied","Data":"ef1b2cf3f83213e09d28d724e4bcc9598ee7e85336592414de4b1ab7610c8a25"}
Oct 30 21:46:40.346616 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:40.346570    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef1b2cf3f83213e09d28d724e4bcc9598ee7e85336592414de4b1ab7610c8a25"
Oct 30 21:46:42.864472 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.864429    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"]
Oct 30 21:46:42.865026 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.864987    5579 cpu_manager.go:414] "containerMap: removing container" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="util"
Oct 30 21:46:42.865026 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865006    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="util"
Oct 30 21:46:42.865026 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865024    5579 cpu_manager.go:414] "containerMap: removing container" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865031    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865040    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865047    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865065    5579 cpu_manager.go:414] "containerMap: removing container" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="extract"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865072    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="extract"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865081    5579 cpu_manager.go:414] "containerMap: removing container" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="extract"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865088    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="extract"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865105    5579 cpu_manager.go:414] "containerMap: removing container" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865112    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865120    5579 cpu_manager.go:414] "containerMap: removing container" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865126    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865136    5579 cpu_manager.go:414] "containerMap: removing container" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865143    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="util"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865165    5579 cpu_manager.go:414] "containerMap: removing container" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865172    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865186    5579 cpu_manager.go:414] "containerMap: removing container" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="pull"
Oct 30 21:46:42.865192 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865192    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865208    5579 cpu_manager.go:414] "containerMap: removing container" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865214    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865227    5579 cpu_manager.go:414] "containerMap: removing container" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865233    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865241    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865249    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865266    5579 cpu_manager.go:414] "containerMap: removing container" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865272    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865281    5579 cpu_manager.go:414] "containerMap: removing container" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865287    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865302    5579 cpu_manager.go:414] "containerMap: removing container" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865308    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865320    5579 cpu_manager.go:414] "containerMap: removing container" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865327    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865359    5579 cpu_manager.go:414] "containerMap: removing container" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865365    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865384    5579 cpu_manager.go:414] "containerMap: removing container" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865391    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865413    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865421    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865429    5579 cpu_manager.go:414] "containerMap: removing container" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865435    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865453    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865462    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865474    5579 cpu_manager.go:414] "containerMap: removing container" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865481    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865495    5579 cpu_manager.go:414] "containerMap: removing container" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865501    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865510    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865517    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865526    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865533    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865549    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865556    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="pull"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865564    5579 cpu_manager.go:414] "containerMap: removing container" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865570    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865594    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865600    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="util"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865614    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865622    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865759    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="1eb811ce-dc00-4867-9177-0a81f1cf4616" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.865771    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="dcefd3f5-fcb7-4b45-83dd-3bf5e890e609" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866005    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b92127c-5bdd-4eba-b702-e763b0982b64" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866023    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="07691439-8e5c-4269-9502-09c582ea2c3d" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866045    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="d95ca2d6-5dc2-4b41-8ba1-1bc7eefac919" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866056    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="8db47b25-f6e9-4802-a4ff-3b653753a8e2" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866070    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="44e1fd54-b2b0-48eb-a61d-2fe991f2c46a" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866081    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="b375421e-7202-45d5-84e4-d8b1a6427421" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866091    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf03a8b7-d16f-42ed-a6d6-4a11a9c0b440" containerName="extract"
Oct 30 21:46:42.866191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.866100    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="664af3c5-3c9d-41ea-bc6f-ffe8e596cdcc" containerName="extract"
Oct 30 21:46:42.869917 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.869894    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.921287 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.921248    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:46:42.930013 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:46:42.929973    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:46:42.950529 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950497    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-metrics-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.950698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950537    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-tmp\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.950698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950559    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtp9n\" (UniqueName: \"kubernetes.io/projected/4a655287-fd3d-4eb2-90f7-48023753c285-kube-api-access-jtp9n\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.950698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950680    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-manifests\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.950806 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950722    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.950843 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.950801    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-webhook-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:42.967243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.967208    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:46:42.967243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.967213    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:46:42.967243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.967236    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:46:42.967457 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.967233    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:46:42.967457 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.967262    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-5cc62\""
Oct 30 21:46:42.997431 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:42.997396    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"]
Oct 30 21:46:43.051675 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051644    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.051863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051688    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-webhook-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.051863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051730    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-metrics-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.051863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051753    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-tmp\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.051863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051780    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtp9n\" (UniqueName: \"kubernetes.io/projected/4a655287-fd3d-4eb2-90f7-48023753c285-kube-api-access-jtp9n\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.051863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.051817    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-manifests\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.052381 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.052353    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-manifests\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.054296 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.054263    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a655287-fd3d-4eb2-90f7-48023753c285-tmp\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.054420 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.054277    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.054420 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.054353    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-webhook-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.054491 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.054427    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a655287-fd3d-4eb2-90f7-48023753c285-metrics-cert\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.107539 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.107503    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtp9n\" (UniqueName: \"kubernetes.io/projected/4a655287-fd3d-4eb2-90f7-48023753c285-kube-api-access-jtp9n\") pod \"opendatahub-operator-controller-manager-8677f9fb98-89nxg\" (UID: \"4a655287-fd3d-4eb2-90f7-48023753c285\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.182394 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.182360    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:43.672901 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:43.672865    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"]
Oct 30 21:46:43.677062 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:46:43.677034    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a655287_fd3d_4eb2_90f7_48023753c285.slice/crio-91f1c6b7e8fb12afdfbc4291c15ebbed605e05e10342ab4c971f7ba4d437d554 WatchSource:0}: Error finding container 91f1c6b7e8fb12afdfbc4291c15ebbed605e05e10342ab4c971f7ba4d437d554: Status 404 returned error can't find the container with id 91f1c6b7e8fb12afdfbc4291c15ebbed605e05e10342ab4c971f7ba4d437d554
Oct 30 21:46:44.364391 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:44.364359    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg" event={"ID":"4a655287-fd3d-4eb2-90f7-48023753c285","Type":"ContainerStarted","Data":"91f1c6b7e8fb12afdfbc4291c15ebbed605e05e10342ab4c971f7ba4d437d554"}
Oct 30 21:46:46.883074 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.883037    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"]
Oct 30 21:46:46.887220 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.887193    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:46.987025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.986990    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-tmp\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:46.987191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.987045    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdbd2\" (UniqueName: \"kubernetes.io/projected/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-kube-api-access-kdbd2\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:46.990021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.989975    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:46:46.990021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.990007    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-65xds\""
Oct 30 21:46:46.990194 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.990145    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 21:46:46.991652 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:46.991631    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"]
Oct 30 21:46:47.088195 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.088161    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-tmp\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:47.088388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.088211    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdbd2\" (UniqueName: \"kubernetes.io/projected/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-kube-api-access-kdbd2\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:47.088635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.088606    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-tmp\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:47.157850 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.157821    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdbd2\" (UniqueName: \"kubernetes.io/projected/1cb2836b-3f1e-46ad-ae9c-0d07030c7114-kube-api-access-kdbd2\") pod \"jobset-operator-674cd59dc5-h64fr\" (UID: \"1cb2836b-3f1e-46ad-ae9c-0d07030c7114\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:47.219345 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.219306    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"
Oct 30 21:46:47.381511 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.381478    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg" event={"ID":"4a655287-fd3d-4eb2-90f7-48023753c285","Type":"ContainerStarted","Data":"7bb74766ca8c063425fd7acfcd37788f283a96b4ab1ec6427e4ea6ff99e1e8de"}
Oct 30 21:46:47.728729 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:47.728684    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr"]
Oct 30 21:46:47.736029 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:46:47.735997    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cb2836b_3f1e_46ad_ae9c_0d07030c7114.slice/crio-eca2bc8cc554faf94bd0ce00cee656d12f49193430d67f55c44df613053ffa43 WatchSource:0}: Error finding container eca2bc8cc554faf94bd0ce00cee656d12f49193430d67f55c44df613053ffa43: Status 404 returned error can't find the container with id eca2bc8cc554faf94bd0ce00cee656d12f49193430d67f55c44df613053ffa43
Oct 30 21:46:48.387486 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:48.387451    5579 generic.go:356] "Generic (PLEG): container finished" podID="4a655287-fd3d-4eb2-90f7-48023753c285" containerID="7bb74766ca8c063425fd7acfcd37788f283a96b4ab1ec6427e4ea6ff99e1e8de" exitCode=0
Oct 30 21:46:48.387943 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:48.387535    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg" event={"ID":"4a655287-fd3d-4eb2-90f7-48023753c285","Type":"ContainerDied","Data":"7bb74766ca8c063425fd7acfcd37788f283a96b4ab1ec6427e4ea6ff99e1e8de"}
Oct 30 21:46:48.389253 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:48.388960    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr" event={"ID":"1cb2836b-3f1e-46ad-ae9c-0d07030c7114","Type":"ContainerStarted","Data":"eca2bc8cc554faf94bd0ce00cee656d12f49193430d67f55c44df613053ffa43"}
Oct 30 21:46:49.395256 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:49.395223    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg" event={"ID":"4a655287-fd3d-4eb2-90f7-48023753c285","Type":"ContainerStarted","Data":"78261e47189274f9a06f633a2abc96f3f9f40455ec4cec3bd891ee9a937305ce"}
Oct 30 21:46:49.395665 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:49.395349    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:46:49.611803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:49.611707    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg" podStartSLOduration=2.630442393 podStartE2EDuration="7.611691787s" totalImagesPullingTime="4.518836055s" totalInitContainerRuntime="462.413339ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:49.564694139 +0000 UTC m=+214.534540559" watchObservedRunningTime="2026-10-30 21:46:49.611691787 +0000 UTC m=+214.581538195"
Oct 30 21:46:51.406474 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:51.406439    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr" event={"ID":"1cb2836b-3f1e-46ad-ae9c-0d07030c7114","Type":"ContainerStarted","Data":"752415058b38e348d23cd6d748d44fb7002d4c2b5e865d0546e42e1322f950bd"}
Oct 30 21:46:51.514852 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:46:51.514799    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h64fr" podStartSLOduration=2.448741574 podStartE2EDuration="5.514784s" totalImagesPullingTime="3.066042426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:51.51412916 +0000 UTC m=+216.483975602" watchObservedRunningTime="2026-10-30 21:46:51.514784 +0000 UTC m=+216.484630408"
Oct 30 21:47:00.402696 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:00.402663    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8677f9fb98-89nxg"
Oct 30 21:47:01.006021 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.005980    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"]
Oct 30 21:47:01.009306 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.009276    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.058565 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.058526    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 21:47:01.058565 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.058542    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:47:01.058766 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.058571    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rrsmr\""
Oct 30 21:47:01.109474 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.109429    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp85n\" (UniqueName: \"kubernetes.io/projected/eef39477-8ed6-4187-b17c-160f83b9a4b1-kube-api-access-dp85n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.109655 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.109494    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef39477-8ed6-4187-b17c-160f83b9a4b1-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.114757 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.114730    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"]
Oct 30 21:47:01.210673 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.210635    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp85n\" (UniqueName: \"kubernetes.io/projected/eef39477-8ed6-4187-b17c-160f83b9a4b1-kube-api-access-dp85n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.210860 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.210695    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef39477-8ed6-4187-b17c-160f83b9a4b1-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.211095 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.211074    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef39477-8ed6-4187-b17c-160f83b9a4b1-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.265199 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.265121    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp85n\" (UniqueName: \"kubernetes.io/projected/eef39477-8ed6-4187-b17c-160f83b9a4b1-kube-api-access-dp85n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4h69l\" (UID: \"eef39477-8ed6-4187-b17c-160f83b9a4b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.320654 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.320625    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"
Oct 30 21:47:01.744561 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:01.744519    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l"]
Oct 30 21:47:01.751172 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:01.751147    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef39477_8ed6_4187_b17c_160f83b9a4b1.slice/crio-df2e880e11f50c93ee5729b92c63e9978c1f829ead18bbaf48f5d6aeb5b626fa WatchSource:0}: Error finding container df2e880e11f50c93ee5729b92c63e9978c1f829ead18bbaf48f5d6aeb5b626fa: Status 404 returned error can't find the container with id df2e880e11f50c93ee5729b92c63e9978c1f829ead18bbaf48f5d6aeb5b626fa
Oct 30 21:47:02.083615 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.083531    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:02.086725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.086703    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.139974 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.139917    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:47:02.140158 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.140145    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:47:02.140384 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.140365    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fxvwt\""
Oct 30 21:47:02.199547 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.199501    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:02.219952 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.219897    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.220115 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.220037    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gstm9\" (UniqueName: \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.320728 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.320689    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gstm9\" (UniqueName: \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.320912 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.320745    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.321123 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.321106    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.382010 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.381920    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gstm9\" (UniqueName: \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-7kkz2\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.397969 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.397913    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:02.456855 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.456824    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l" event={"ID":"eef39477-8ed6-4187-b17c-160f83b9a4b1","Type":"ContainerStarted","Data":"df2e880e11f50c93ee5729b92c63e9978c1f829ead18bbaf48f5d6aeb5b626fa"}
Oct 30 21:47:02.832333 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:02.832291    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:02.839320 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:02.839291    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4295d304_5d11_4cd6_aabd_4f270aa226bf.slice/crio-f4b78bed5e78264aa98ed99c8107f5996051f7ffdd70a7cf540502481414073d WatchSource:0}: Error finding container f4b78bed5e78264aa98ed99c8107f5996051f7ffdd70a7cf540502481414073d: Status 404 returned error can't find the container with id f4b78bed5e78264aa98ed99c8107f5996051f7ffdd70a7cf540502481414073d
Oct 30 21:47:03.463089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:03.463051    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" event={"ID":"4295d304-5d11-4cd6-aabd-4f270aa226bf","Type":"ContainerStarted","Data":"f4b78bed5e78264aa98ed99c8107f5996051f7ffdd70a7cf540502481414073d"}
Oct 30 21:47:05.476583 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:05.476544    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l" event={"ID":"eef39477-8ed6-4187-b17c-160f83b9a4b1","Type":"ContainerStarted","Data":"a391fb729a569a6f360a8079d505e78d0ce66a828c2599544deb31171cf452ca"}
Oct 30 21:47:05.694025 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:05.693959    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4h69l" podStartSLOduration=3.009254694 podStartE2EDuration="5.693923954s" totalImagesPullingTime="2.68466926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:05.646271822 +0000 UTC m=+230.616118231" watchObservedRunningTime="2026-10-30 21:47:05.693923954 +0000 UTC m=+230.663770363"
Oct 30 21:47:07.033850 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.033813    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"]
Oct 30 21:47:07.037693 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.037659    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.136224 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.136179    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qbx5p\""
Oct 30 21:47:07.136395 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.136298    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 21:47:07.138091 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.138055    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 21:47:07.138205 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.138189    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"]
Oct 30 21:47:07.168355 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.168323    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsnsg\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-kube-api-access-xsnsg\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.168355 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.168359    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.269047 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.269012    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsnsg\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-kube-api-access-xsnsg\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.269251 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.269051    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.327337 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.327266    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsnsg\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-kube-api-access-xsnsg\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.328624 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.328598    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22006b91-c2f8-41d9-8f61-40a8cbeb5942-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-2b5rt\" (UID: \"22006b91-c2f8-41d9-8f61-40a8cbeb5942\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.352443 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.352409    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:07.737660 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:07.737625    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"]
Oct 30 21:47:07.744396 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:07.744364    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22006b91_c2f8_41d9_8f61_40a8cbeb5942.slice/crio-f25fe0ca34476c3c5b74faf4adb8fda410f1385faff3a5994e3fa47e706c2825 WatchSource:0}: Error finding container f25fe0ca34476c3c5b74faf4adb8fda410f1385faff3a5994e3fa47e706c2825: Status 404 returned error can't find the container with id f25fe0ca34476c3c5b74faf4adb8fda410f1385faff3a5994e3fa47e706c2825
Oct 30 21:47:08.492892 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:08.492853    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt" event={"ID":"22006b91-c2f8-41d9-8f61-40a8cbeb5942","Type":"ContainerStarted","Data":"f25fe0ca34476c3c5b74faf4adb8fda410f1385faff3a5994e3fa47e706c2825"}
Oct 30 21:47:08.494613 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:08.494588    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" event={"ID":"4295d304-5d11-4cd6-aabd-4f270aa226bf","Type":"ContainerStarted","Data":"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"}
Oct 30 21:47:08.495006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:08.494700    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:08.714443 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:08.714393    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" podStartSLOduration=1.441470301 podStartE2EDuration="6.714379234s" totalImagesPullingTime="5.272908933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:08.666464272 +0000 UTC m=+233.636310702" watchObservedRunningTime="2026-10-30 21:47:08.714379234 +0000 UTC m=+233.684225642"
Oct 30 21:47:12.515450 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:12.515397    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt" event={"ID":"22006b91-c2f8-41d9-8f61-40a8cbeb5942","Type":"ContainerStarted","Data":"63f54785c4efc28a85e39efe5a724f714feaa65b33acdd10ebd2163d0b68b2e2"}
Oct 30 21:47:12.515450 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:12.515458    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:12.634494 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:12.634422    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt" podStartSLOduration=2.874853405 podStartE2EDuration="6.63440506s" totalImagesPullingTime="3.759551655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:12.634049201 +0000 UTC m=+237.603895631" watchObservedRunningTime="2026-10-30 21:47:12.63440506 +0000 UTC m=+237.604251471"
Oct 30 21:47:12.928601 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:47:12.928563    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:47:13.840399 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.840357    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"]
Oct 30 21:47:13.843956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.843919    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:13.925745 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.925716    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:13.925745 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.925748    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgdq\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-kube-api-access-zcgdq\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:13.939955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.939908    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cvgm8\""
Oct 30 21:47:13.942551 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.942524    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"]
Oct 30 21:47:13.987979 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.987942    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"]
Oct 30 21:47:13.991127 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:13.991111    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.027146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.027111    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:14.027146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.027150    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgdq\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-kube-api-access-zcgdq\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:14.041227 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.041199    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"]
Oct 30 21:47:14.045512 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.045485    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v7c7z\""
Oct 30 21:47:14.045632 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.045493    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 21:47:14.045632 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.045545    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 21:47:14.090846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.090774    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgdq\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-kube-api-access-zcgdq\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:14.091124 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.091107    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faca604-6bac-4717-8fc8-3770caf87fe3-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-llflj\" (UID: \"3faca604-6bac-4717-8fc8-3770caf87fe3\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:14.127863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.127831    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjxw\" (UniqueName: \"kubernetes.io/projected/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-kube-api-access-xmjxw\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.128028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.127875    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.128028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.127982    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.155851 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.155826    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"
Oct 30 21:47:14.230104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.228513    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjxw\" (UniqueName: \"kubernetes.io/projected/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-kube-api-access-xmjxw\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.230104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.228581    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.230104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.228636    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.230104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.229801    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.231276 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.231246    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.287141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.287114    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjxw\" (UniqueName: \"kubernetes.io/projected/df20a534-e1fa-47ec-8147-2af4fd7ff8e8-kube-api-access-xmjxw\") pod \"kuadrant-console-plugin-66c4fb575d-xv78j\" (UID: \"df20a534-e1fa-47ec-8147-2af4fd7ff8e8\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.302965 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.302911    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"
Oct 30 21:47:14.528249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.528217    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj"]
Oct 30 21:47:14.535289 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:14.535263    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3faca604_6bac_4717_8fc8_3770caf87fe3.slice/crio-397e0ee18c7d51fcfc7b57f216e5ade95c4ae05a29e194f37175da0bdeeb59f8 WatchSource:0}: Error finding container 397e0ee18c7d51fcfc7b57f216e5ade95c4ae05a29e194f37175da0bdeeb59f8: Status 404 returned error can't find the container with id 397e0ee18c7d51fcfc7b57f216e5ade95c4ae05a29e194f37175da0bdeeb59f8
Oct 30 21:47:14.674177 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:14.674144    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j"]
Oct 30 21:47:14.680565 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:14.680534    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf20a534_e1fa_47ec_8147_2af4fd7ff8e8.slice/crio-1b6d9a3f63e78e349a6c67d12f0fe0322d006d7259f1e794c0415f07076d19a2 WatchSource:0}: Error finding container 1b6d9a3f63e78e349a6c67d12f0fe0322d006d7259f1e794c0415f07076d19a2: Status 404 returned error can't find the container with id 1b6d9a3f63e78e349a6c67d12f0fe0322d006d7259f1e794c0415f07076d19a2
Oct 30 21:47:15.531128 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:15.531087    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j" event={"ID":"df20a534-e1fa-47ec-8147-2af4fd7ff8e8","Type":"ContainerStarted","Data":"1b6d9a3f63e78e349a6c67d12f0fe0322d006d7259f1e794c0415f07076d19a2"}
Oct 30 21:47:15.535022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:15.534990    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj" event={"ID":"3faca604-6bac-4717-8fc8-3770caf87fe3","Type":"ContainerStarted","Data":"2c2088830007a29cc892987baf1df372a29f7cb1a9927ebb350c248f76ef8ed2"}
Oct 30 21:47:15.535160 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:15.535033    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj" event={"ID":"3faca604-6bac-4717-8fc8-3770caf87fe3","Type":"ContainerStarted","Data":"397e0ee18c7d51fcfc7b57f216e5ade95c4ae05a29e194f37175da0bdeeb59f8"}
Oct 30 21:47:15.646334 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:15.646283    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-llflj" podStartSLOduration=2.6462699179999998 podStartE2EDuration="2.646269918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:15.645361021 +0000 UTC m=+240.615207430" watchObservedRunningTime="2026-10-30 21:47:15.646269918 +0000 UTC m=+240.616116327"
Oct 30 21:47:16.622512 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.622473    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"]
Oct 30 21:47:16.626891 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.626870    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.677055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.677022    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:47:16.677055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.677039    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:47:16.724067 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.723967    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 21:47:16.724067 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.724028    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 21:47:16.724313 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.724080    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z98gw\""
Oct 30 21:47:16.726175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.726140    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"]
Oct 30 21:47:16.751115 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.751084    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr9c\" (UniqueName: \"kubernetes.io/projected/548a274d-6378-40b4-95e4-7f910b39f11e-kube-api-access-zfr9c\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.751343 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.751133    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a274d-6378-40b4-95e4-7f910b39f11e-tls-certs\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.751343 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.751246    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548a274d-6378-40b4-95e4-7f910b39f11e-tmp\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.852388 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.852343    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548a274d-6378-40b4-95e4-7f910b39f11e-tmp\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.852581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.852425    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr9c\" (UniqueName: \"kubernetes.io/projected/548a274d-6378-40b4-95e4-7f910b39f11e-kube-api-access-zfr9c\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.852581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.852463    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a274d-6378-40b4-95e4-7f910b39f11e-tls-certs\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.870960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.855438    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548a274d-6378-40b4-95e4-7f910b39f11e-tmp\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.870960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.867156    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a274d-6378-40b4-95e4-7f910b39f11e-tls-certs\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.922564 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.913769    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr9c\" (UniqueName: \"kubernetes.io/projected/548a274d-6378-40b4-95e4-7f910b39f11e-kube-api-access-zfr9c\") pod \"kube-auth-proxy-78776654bd-zqbr7\" (UID: \"548a274d-6378-40b4-95e4-7f910b39f11e\") " pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:16.939486 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:16.939260    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"
Oct 30 21:47:17.343402 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:17.343313    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78776654bd-zqbr7"]
Oct 30 21:47:17.547486 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:17.547409    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7" event={"ID":"548a274d-6378-40b4-95e4-7f910b39f11e","Type":"ContainerStarted","Data":"d2f5578d9a4d0bbf2217429c1eea35190f794890a79c0b1a50e1390479314ad3"}
Oct 30 21:47:18.523806 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:18.523776    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt"
Oct 30 21:47:19.502328 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:19.502297    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:21.570205 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:21.570168    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j" event={"ID":"df20a534-e1fa-47ec-8147-2af4fd7ff8e8","Type":"ContainerStarted","Data":"48140af013b5a055c6c0c91e989a57d6b2535b885f54dda7b2e4121e4674c192"}
Oct 30 21:47:21.571887 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:21.571861    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7" event={"ID":"548a274d-6378-40b4-95e4-7f910b39f11e","Type":"ContainerStarted","Data":"a0a022381cd047e920f9c3a21176e6f40eaf34d0182d072855be17745173ad0e"}
Oct 30 21:47:21.758579 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:21.758526    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xv78j" podStartSLOduration=2.078986064 podStartE2EDuration="8.758510941s" totalImagesPullingTime="6.679524877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:21.757777214 +0000 UTC m=+246.727623624" watchObservedRunningTime="2026-10-30 21:47:21.758510941 +0000 UTC m=+246.728357351"
Oct 30 21:47:21.869506 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:21.869451    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78776654bd-zqbr7" podStartSLOduration=2.420839314 podStartE2EDuration="5.869436588s" totalImagesPullingTime="3.448597274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:21.868923796 +0000 UTC m=+246.838770205" watchObservedRunningTime="2026-10-30 21:47:21.869436588 +0000 UTC m=+246.839282997"
Oct 30 21:47:26.722829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.722785    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-2ssgp"]
Oct 30 21:47:26.727119 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.727091    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.744688 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.744657    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-bound-sa-token\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.744826 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.744709    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhn8c\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-kube-api-access-vhn8c\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.822144 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.822114    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x8z8s\""
Oct 30 21:47:26.823959 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.823901    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-2ssgp"]
Oct 30 21:47:26.846045 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.846015    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-bound-sa-token\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.846207 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.846051    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhn8c\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-kube-api-access-vhn8c\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.900116 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.900081    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-bound-sa-token\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:26.900330 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:26.900305    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhn8c\" (UniqueName: \"kubernetes.io/projected/f1a31234-de2b-4b88-afd5-24b8c263a506-kube-api-access-vhn8c\") pod \"cert-manager-597b95cb84-2ssgp\" (UID: \"f1a31234-de2b-4b88-afd5-24b8c263a506\") " pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:27.040136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:27.040046    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-2ssgp"
Oct 30 21:47:27.410449 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:27.410411    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-2ssgp"]
Oct 30 21:47:27.416361 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:27.416333    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1a31234_de2b_4b88_afd5_24b8c263a506.slice/crio-271a18af21a7bb0e9f5c6f8e784ecad073783f1e89723a487de3ae5542413e6e WatchSource:0}: Error finding container 271a18af21a7bb0e9f5c6f8e784ecad073783f1e89723a487de3ae5542413e6e: Status 404 returned error can't find the container with id 271a18af21a7bb0e9f5c6f8e784ecad073783f1e89723a487de3ae5542413e6e
Oct 30 21:47:27.602466 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:27.602432    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-2ssgp" event={"ID":"f1a31234-de2b-4b88-afd5-24b8c263a506","Type":"ContainerStarted","Data":"581b2239405d99ca8c22593af931a98f162c7c3c91a5d2878bbee07ff68e6f41"}
Oct 30 21:47:27.602634 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:27.602480    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-2ssgp" event={"ID":"f1a31234-de2b-4b88-afd5-24b8c263a506","Type":"ContainerStarted","Data":"271a18af21a7bb0e9f5c6f8e784ecad073783f1e89723a487de3ae5542413e6e"}
Oct 30 21:47:27.722254 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:27.722142    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-2ssgp" podStartSLOduration=1.722120249 podStartE2EDuration="1.722120249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:27.711917931 +0000 UTC m=+252.681764339" watchObservedRunningTime="2026-10-30 21:47:27.722120249 +0000 UTC m=+252.691966660"
Oct 30 21:47:37.369382 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.369347    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:37.369811 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.369556    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" podUID="4295d304-5d11-4cd6-aabd-4f270aa226bf" containerName="manager" containerID="cri-o://a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85" gracePeriod=10
Oct 30 21:47:37.618442 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.618417    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:37.642555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.642528    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\") pod \"4295d304-5d11-4cd6-aabd-4f270aa226bf\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") "
Oct 30 21:47:37.642706 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.642594    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\" (UniqueName: \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\") pod \"4295d304-5d11-4cd6-aabd-4f270aa226bf\" (UID: \"4295d304-5d11-4cd6-aabd-4f270aa226bf\") "
Oct 30 21:47:37.642972 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.642924    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume" pod "4295d304-5d11-4cd6-aabd-4f270aa226bf" (UID: "4295d304-5d11-4cd6-aabd-4f270aa226bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:47:37.644701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.644680    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9" pod "4295d304-5d11-4cd6-aabd-4f270aa226bf" (UID: "4295d304-5d11-4cd6-aabd-4f270aa226bf"). InnerVolumeSpecName "kube-api-access-gstm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:37.650795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.650769    5579 generic.go:356] "Generic (PLEG): container finished" podID="4295d304-5d11-4cd6-aabd-4f270aa226bf" containerID="a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85" exitCode=0
Oct 30 21:47:37.650886 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.650813    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"
Oct 30 21:47:37.650886 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.650841    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" event={"ID":"4295d304-5d11-4cd6-aabd-4f270aa226bf","Type":"ContainerDied","Data":"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"}
Oct 30 21:47:37.650994 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.650893    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2" event={"ID":"4295d304-5d11-4cd6-aabd-4f270aa226bf","Type":"ContainerDied","Data":"f4b78bed5e78264aa98ed99c8107f5996051f7ffdd70a7cf540502481414073d"}
Oct 30 21:47:37.650994 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.650922    5579 scope.go:122] "RemoveContainer" containerID="a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"
Oct 30 21:47:37.659430 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.659414    5579 scope.go:122] "RemoveContainer" containerID="a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"
Oct 30 21:47:37.659691 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:47:37.659673    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85\": container with ID starting with a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85 not found: ID does not exist" containerID="a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"
Oct 30 21:47:37.659734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.659700    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85"} err="failed to get container status \"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85\": rpc error: code = NotFound desc = could not find container \"a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85\": container with ID starting with a2ba9c23f7d33e1cd447946dbc4b0da765cf00de8d83896f3d64001965ef4a85 not found: ID does not exist"
Oct 30 21:47:37.743274 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.743231    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gstm9\" (UniqueName: \"kubernetes.io/projected/4295d304-5d11-4cd6-aabd-4f270aa226bf-kube-api-access-gstm9\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.743274 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.743267    5579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4295d304-5d11-4cd6-aabd-4f270aa226bf-extensions-socket-volume\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:47:37.855072 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.855036    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:37.859837 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:37.859755    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-7kkz2"]
Oct 30 21:47:39.144543 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:39.144509    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4295d304-5d11-4cd6-aabd-4f270aa226bf" path="/var/lib/kubelet/pods/4295d304-5d11-4cd6-aabd-4f270aa226bf/volumes"
Oct 30 21:47:42.124199 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.124165    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"]
Oct 30 21:47:42.124637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.124489    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4295d304-5d11-4cd6-aabd-4f270aa226bf" containerName="manager"
Oct 30 21:47:42.124637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.124499    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4295d304-5d11-4cd6-aabd-4f270aa226bf" containerName="manager"
Oct 30 21:47:42.124637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.124567    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="4295d304-5d11-4cd6-aabd-4f270aa226bf" containerName="manager"
Oct 30 21:47:42.171530 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.171499    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.227335 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.227307    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-nr5fz\""
Oct 30 21:47:42.273077 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.273051    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:47:42.273077 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.273052    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:47:42.284771 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.284741    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.284907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.284783    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.284907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.284811    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586dw\" (UniqueName: \"kubernetes.io/projected/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-kube-api-access-586dw\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.284907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.284893    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.367265 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.367230    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 21:47:42.368996 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.368973    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"]
Oct 30 21:47:42.385989 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.385959    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386124 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386003    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386124 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386021    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586dw\" (UniqueName: \"kubernetes.io/projected/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-kube-api-access-586dw\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386124 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386074    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386381 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386360    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386453 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386398    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.386812 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.386795    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.441058 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.441023    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586dw\" (UniqueName: \"kubernetes.io/projected/5a3ccb59-fc2b-4a72-b415-8e43a60f5be4-kube-api-access-586dw\") pod \"kserve-module-controller-manager-7566cf5fc8-4jhqj\" (UID: \"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.502263 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.502227    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:42.929125 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:47:42.929088    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:47:42.951863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:42.951832    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"]
Oct 30 21:47:42.958409 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:42.958365    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3ccb59_fc2b_4a72_b415_8e43a60f5be4.slice/crio-9e8aa830570ec801c1299259d3dc678e44dba0cff546fbb8741bc43a876c4730 WatchSource:0}: Error finding container 9e8aa830570ec801c1299259d3dc678e44dba0cff546fbb8741bc43a876c4730: Status 404 returned error can't find the container with id 9e8aa830570ec801c1299259d3dc678e44dba0cff546fbb8741bc43a876c4730
Oct 30 21:47:43.682599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:43.682565    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj" event={"ID":"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4","Type":"ContainerStarted","Data":"9e8aa830570ec801c1299259d3dc678e44dba0cff546fbb8741bc43a876c4730"}
Oct 30 21:47:45.695059 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:45.695020    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj" event={"ID":"5a3ccb59-fc2b-4a72-b415-8e43a60f5be4","Type":"ContainerStarted","Data":"8c25abcb00c86f0ec313622ef69292eedfa73ae51c29add1755129b26cec9837"}
Oct 30 21:47:45.695486 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:45.695143    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:47:45.901759 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:45.901705    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj" podStartSLOduration=2.003227633 podStartE2EDuration="3.901689781s" totalImagesPullingTime="1.898462148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:45.853910203 +0000 UTC m=+270.823756612" watchObservedRunningTime="2026-10-30 21:47:45.901689781 +0000 UTC m=+270.871536190"
Oct 30 21:47:55.961558 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:55.961477    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:47:56.014739 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.014705    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.027434 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.027409    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:47:56.072296 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.072270    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 21:47:56.108478 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.108443    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrks\" (UniqueName: \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.108644 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.108498    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.200175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.200142    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:47:56.209943 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.209893    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrks\" (UniqueName: \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.210093 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.209954    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.210532 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.210513    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.264236 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.264157    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrks\" (UniqueName: \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\") pod \"limitador-limitador-74dfcfb894-nnkr2\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.365399 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.365367    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:47:56.734860 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.734827    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:47:56.741647 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:47:56.741617    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f10eef_3a4d_4124_8c86_f8da73bd005f.slice/crio-e3d9e1c90c8a665697099fd2e9336868ca30a81649d9024f4332361743fde580 WatchSource:0}: Error finding container e3d9e1c90c8a665697099fd2e9336868ca30a81649d9024f4332361743fde580: Status 404 returned error can't find the container with id e3d9e1c90c8a665697099fd2e9336868ca30a81649d9024f4332361743fde580
Oct 30 21:47:56.753178 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:47:56.753151    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" event={"ID":"05f10eef-3a4d-4124-8c86-f8da73bd005f","Type":"ContainerStarted","Data":"e3d9e1c90c8a665697099fd2e9336868ca30a81649d9024f4332361743fde580"}
Oct 30 21:48:00.777102 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:00.777046    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" event={"ID":"05f10eef-3a4d-4124-8c86-f8da73bd005f","Type":"ContainerStarted","Data":"d7671ddf1d42da34805c3033eb83522b2d427409ca75ce57d556383a7e46e263"}
Oct 30 21:48:00.777536 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:00.777194    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:48:00.887669 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:00.887607    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" podStartSLOduration=2.517812691 podStartE2EDuration="5.887584672s" totalImagesPullingTime="3.369771981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:00.885675105 +0000 UTC m=+285.855521514" watchObservedRunningTime="2026-10-30 21:48:00.887584672 +0000 UTC m=+285.857431082"
Oct 30 21:48:06.707496 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:06.707459    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jhqj"
Oct 30 21:48:11.783290 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:11.783260    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:48:12.928786 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:48:12.928745    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:48:14.398180 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:14.398149    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:48:14.398689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:14.398352    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" podUID="05f10eef-3a4d-4124-8c86-f8da73bd005f" containerName="limitador" containerID="cri-o://d7671ddf1d42da34805c3033eb83522b2d427409ca75ce57d556383a7e46e263" gracePeriod=30
Oct 30 21:48:14.859088 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:14.859053    5579 generic.go:356] "Generic (PLEG): container finished" podID="05f10eef-3a4d-4124-8c86-f8da73bd005f" containerID="d7671ddf1d42da34805c3033eb83522b2d427409ca75ce57d556383a7e46e263" exitCode=0
Oct 30 21:48:14.859264 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:14.859133    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" event={"ID":"05f10eef-3a4d-4124-8c86-f8da73bd005f","Type":"ContainerDied","Data":"d7671ddf1d42da34805c3033eb83522b2d427409ca75ce57d556383a7e46e263"}
Oct 30 21:48:14.947542 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:14.947515    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:48:15.087424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.087349    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\" (UniqueName: \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\") pod \"05f10eef-3a4d-4124-8c86-f8da73bd005f\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") "
Oct 30 21:48:15.087570 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.087445    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\" (UniqueName: \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\") pod \"05f10eef-3a4d-4124-8c86-f8da73bd005f\" (UID: \"05f10eef-3a4d-4124-8c86-f8da73bd005f\") "
Oct 30 21:48:15.087825 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.087796    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file" pod "05f10eef-3a4d-4124-8c86-f8da73bd005f" (UID: "05f10eef-3a4d-4124-8c86-f8da73bd005f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:15.089487 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.089462    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks" pod "05f10eef-3a4d-4124-8c86-f8da73bd005f" (UID: "05f10eef-3a4d-4124-8c86-f8da73bd005f"). InnerVolumeSpecName "kube-api-access-pkrks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:15.188628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.188604    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrks\" (UniqueName: \"kubernetes.io/projected/05f10eef-3a4d-4124-8c86-f8da73bd005f-kube-api-access-pkrks\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:48:15.188628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.188629    5579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05f10eef-3a4d-4124-8c86-f8da73bd005f-config-file\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:48:15.864891 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.864859    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"
Oct 30 21:48:15.865369 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.864863    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-nnkr2" event={"ID":"05f10eef-3a4d-4124-8c86-f8da73bd005f","Type":"ContainerDied","Data":"e3d9e1c90c8a665697099fd2e9336868ca30a81649d9024f4332361743fde580"}
Oct 30 21:48:15.865369 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:15.865030    5579 scope.go:122] "RemoveContainer" containerID="d7671ddf1d42da34805c3033eb83522b2d427409ca75ce57d556383a7e46e263"
Oct 30 21:48:16.017027 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:16.016996    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:48:16.063370 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:16.063338    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-nnkr2"]
Oct 30 21:48:17.145313 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:17.145271    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05f10eef-3a4d-4124-8c86-f8da73bd005f" path="/var/lib/kubelet/pods/05f10eef-3a4d-4124-8c86-f8da73bd005f/volumes"
Oct 30 21:48:18.947465 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:18.947429    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"]
Oct 30 21:48:18.947864 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:18.947768    5579 cpu_manager.go:414] "containerMap: removing container" podUID="05f10eef-3a4d-4124-8c86-f8da73bd005f" containerName="limitador"
Oct 30 21:48:18.947864 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:18.947779    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05f10eef-3a4d-4124-8c86-f8da73bd005f" containerName="limitador"
Oct 30 21:48:18.947864 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:18.947849    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="05f10eef-3a4d-4124-8c86-f8da73bd005f" containerName="limitador"
Oct 30 21:48:18.951635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:18.951594    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.000637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.000611    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:48:19.013949 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.013901    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f7ckp\""
Oct 30 21:48:19.018456 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.018425    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5h2v\" (UniqueName: \"kubernetes.io/projected/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-kube-api-access-x5h2v\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.018614 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.018539    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-data\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.047204 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.047169    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 21:48:19.047371 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.047254    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:48:19.048879 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.048859    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"]
Oct 30 21:48:19.120104 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.120060    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5h2v\" (UniqueName: \"kubernetes.io/projected/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-kube-api-access-x5h2v\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.120311 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.120164    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-data\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.120584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.120562    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-data\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.174629 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.174591    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5h2v\" (UniqueName: \"kubernetes.io/projected/ff670e45-2e5b-49d6-8fa8-95f9f117c8d8-kube-api-access-x5h2v\") pod \"postgres-7cdbf6dc44-sb4lj\" (UID: \"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.264774 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.264682    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:19.637940 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.637891    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"]
Oct 30 21:48:19.644116 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:19.644086    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff670e45_2e5b_49d6_8fa8_95f9f117c8d8.slice/crio-a6160753bab1eabe29b4c0c401580a9b96f29b34f48564b642f05067db4994a2 WatchSource:0}: Error finding container a6160753bab1eabe29b4c0c401580a9b96f29b34f48564b642f05067db4994a2: Status 404 returned error can't find the container with id a6160753bab1eabe29b4c0c401580a9b96f29b34f48564b642f05067db4994a2
Oct 30 21:48:19.890916 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:19.890824    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj" event={"ID":"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8","Type":"ContainerStarted","Data":"a6160753bab1eabe29b4c0c401580a9b96f29b34f48564b642f05067db4994a2"}
Oct 30 21:48:26.931720 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:26.931669    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj" event={"ID":"ff670e45-2e5b-49d6-8fa8-95f9f117c8d8","Type":"ContainerStarted","Data":"070cc4269653bf44d11ebbaad11d339e197bfee15ecde4d470d25935ef394a4e"}
Oct 30 21:48:26.932249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:26.931817    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:27.040000 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:27.039915    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj" podStartSLOduration=2.0846604539999998 podStartE2EDuration="9.039897384s" totalImagesPullingTime="6.95523693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:27.038455772 +0000 UTC m=+312.008302182" watchObservedRunningTime="2026-10-30 21:48:27.039897384 +0000 UTC m=+312.009743794"
Oct 30 21:48:32.978450 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:32.978418    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sb4lj"
Oct 30 21:48:40.675283 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.675244    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:48:40.682778 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.682752    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.732210 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.732174    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:48:40.732393 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.732375    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lrchh\""
Oct 30 21:48:40.778939 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.778902    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:48:40.779108 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.778983    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:48:40.787812 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.787786    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:48:40.816379 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.816347    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.816532 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.816401    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wkx\" (UniqueName: \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.816532 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.816497    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.917747 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.917706    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.917922 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.917764    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wkx\" (UniqueName: \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.917922 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.917799    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.920251 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.920220    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.920375 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.920261    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.985775 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.985705    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wkx\" (UniqueName: \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\") pod \"maas-controller-579cf7c6d-k9c8n\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") " pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:40.995554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:40.995522    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:41.136146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.136104    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 21:48:41.141109 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.141084    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.203734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.203700    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 21:48:41.221312 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.221279    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.221514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.221350    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5sb5\" (UniqueName: \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.221514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.221430    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.322599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.322510    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5sb5\" (UniqueName: \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.322599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.322554    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.322599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.322592    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.325162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.325138    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.325279 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.325137    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.375461 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.375426    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:48:41.377582 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.377557    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5sb5\" (UniqueName: \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\") pod \"maas-controller-5844bc79b5-5rxcg\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") " pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.381045 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:41.381022    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6614075_e625_4182_b031_3f696068eeba.slice/crio-a2195c8425c6e8d5cfb1426af3d0b5597916edd72fa203371b391c5d2f055303 WatchSource:0}: Error finding container a2195c8425c6e8d5cfb1426af3d0b5597916edd72fa203371b391c5d2f055303: Status 404 returned error can't find the container with id a2195c8425c6e8d5cfb1426af3d0b5597916edd72fa203371b391c5d2f055303
Oct 30 21:48:41.454725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.454687    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:41.825720 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:41.825683    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 21:48:41.833124 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:41.833091    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899dbfe4_20fe_43c2_ad18_538ab2d213e2.slice/crio-efd4ae7720a646bccc680a1d6fed7d4e274ea2665e7057b1c282cd64f0c82f5b WatchSource:0}: Error finding container efd4ae7720a646bccc680a1d6fed7d4e274ea2665e7057b1c282cd64f0c82f5b: Status 404 returned error can't find the container with id efd4ae7720a646bccc680a1d6fed7d4e274ea2665e7057b1c282cd64f0c82f5b
Oct 30 21:48:42.012789 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:42.012756    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" event={"ID":"a6614075-e625-4182-b031-3f696068eeba","Type":"ContainerStarted","Data":"a2195c8425c6e8d5cfb1426af3d0b5597916edd72fa203371b391c5d2f055303"}
Oct 30 21:48:42.013972 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:42.013921    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" event={"ID":"899dbfe4-20fe-43c2-ad18-538ab2d213e2","Type":"ContainerStarted","Data":"efd4ae7720a646bccc680a1d6fed7d4e274ea2665e7057b1c282cd64f0c82f5b"}
Oct 30 21:48:42.940256 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:48:42.940213    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:48:45.034256 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:45.034198    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" event={"ID":"a6614075-e625-4182-b031-3f696068eeba","Type":"ContainerStarted","Data":"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"}
Oct 30 21:48:45.034726 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:45.034421    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:45.180177 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:45.180075    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" podStartSLOduration=1.658133208 podStartE2EDuration="5.180057255s" totalImagesPullingTime="3.521924047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:45.178015651 +0000 UTC m=+330.147862063" watchObservedRunningTime="2026-10-30 21:48:45.180057255 +0000 UTC m=+330.149903663"
Oct 30 21:48:46.043132 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:46.043089    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" event={"ID":"899dbfe4-20fe-43c2-ad18-538ab2d213e2","Type":"ContainerStarted","Data":"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"}
Oct 30 21:48:46.173149 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:46.173097    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" podStartSLOduration=1.7614356180000001 podStartE2EDuration="5.173084164s" totalImagesPullingTime="3.411648546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:46.171269724 +0000 UTC m=+331.141116133" watchObservedRunningTime="2026-10-30 21:48:46.173084164 +0000 UTC m=+331.142930570"
Oct 30 21:48:47.049703 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.049661    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:47.457506 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.457469    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-qxzff"]
Oct 30 21:48:47.461728 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.461697    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.510473 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.510441    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 21:48:47.510652 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.510591    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-b8qmr\""
Oct 30 21:48:47.543716 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.543682    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-qxzff"]
Oct 30 21:48:47.558978 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.558948    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:48:47.562521 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.562500    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.581995 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.581957    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65l4r\" (UniqueName: \"kubernetes.io/projected/a119f87c-e73c-42f5-a012-fbe11436e92f-kube-api-access-65l4r\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.582149 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.582076    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a119f87c-e73c-42f5-a012-fbe11436e92f-cert\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.611200 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.611171    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fxrc6\""
Oct 30 21:48:47.611346 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.611217    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 21:48:47.640619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.640591    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:48:47.670316 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.670280    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xzghp"]
Oct 30 21:48:47.673970 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.673945    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.683315 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.683290    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a119f87c-e73c-42f5-a012-fbe11436e92f-cert\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.683459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.683364    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8287b\" (UniqueName: \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.683459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.683431    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65l4r\" (UniqueName: \"kubernetes.io/projected/a119f87c-e73c-42f5-a012-fbe11436e92f-kube-api-access-65l4r\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.683593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.683465    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.686035 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.686011    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a119f87c-e73c-42f5-a012-fbe11436e92f-cert\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.725816 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.725741    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 21:48:47.725816 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.725741    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rm5b6\""
Oct 30 21:48:47.734818 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.734791    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xzghp"]
Oct 30 21:48:47.737613 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.737589    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65l4r\" (UniqueName: \"kubernetes.io/projected/a119f87c-e73c-42f5-a012-fbe11436e92f-kube-api-access-65l4r\") pod \"kserve-controller-manager-776cc66d47-qxzff\" (UID: \"a119f87c-e73c-42f5-a012-fbe11436e92f\") " pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.770515 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.770480    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-4jbjt"]
Oct 30 21:48:47.773956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.773922    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.774180 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.774159    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:47.784253 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.784230    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8287b\" (UniqueName: \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.784389 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.784273    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xb7\" (UniqueName: \"kubernetes.io/projected/69ab7af8-bde2-475a-8077-051735a3f3a2-kube-api-access-b8xb7\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.784389 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.784300    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.784389 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.784325    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ab7af8-bde2-475a-8077-051735a3f3a2-tls-certs\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.786898 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.786878    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.830156 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.830123    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 21:48:47.830307 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.830141    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 21:48:47.830307 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.830211    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8dcrk\""
Oct 30 21:48:47.838637 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.838611    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-4jbjt"]
Oct 30 21:48:47.842418 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.842355    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8287b\" (UniqueName: \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\") pod \"llmisvc-controller-manager-869d5dcc5d-6xsvg\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.875500 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.875468    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:47.885839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.885816    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xb7\" (UniqueName: \"kubernetes.io/projected/69ab7af8-bde2-475a-8077-051735a3f3a2-kube-api-access-b8xb7\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.885974 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.885857    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-metrics-certs\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.885974 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.885905    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ab7af8-bde2-475a-8077-051735a3f3a2-tls-certs\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.886075 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.885970    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4zz\" (UniqueName: \"kubernetes.io/projected/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-kube-api-access-6n4zz\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.886161 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.886145    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-cert\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.888643 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.888612    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69ab7af8-bde2-475a-8077-051735a3f3a2-tls-certs\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.943842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.943777    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xb7\" (UniqueName: \"kubernetes.io/projected/69ab7af8-bde2-475a-8077-051735a3f3a2-kube-api-access-b8xb7\") pod \"model-serving-api-75bd89fdfc-xzghp\" (UID: \"69ab7af8-bde2-475a-8077-051735a3f3a2\") " pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.987699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.987618    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-metrics-certs\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.987839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.987708    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4zz\" (UniqueName: \"kubernetes.io/projected/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-kube-api-access-6n4zz\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.987839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.987742    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-cert\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.988078 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.988051    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:47.990037 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.990015    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-metrics-certs\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:47.990129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:47.990040    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-cert\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:48.049837 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.049633    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4zz\" (UniqueName: \"kubernetes.io/projected/f347f2c6-60fb-48b2-8fd9-11e9305a4b0b-kube-api-access-6n4zz\") pod \"odh-model-controller-769875db56-4jbjt\" (UID: \"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b\") " pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:48.090084 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.090045    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:48.152379 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.152312    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-qxzff"]
Oct 30 21:48:48.156608 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:48.156576    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda119f87c_e73c_42f5_a012_fbe11436e92f.slice/crio-5f1cad2951ad11c5489a98887937891ea04a1c48bd4be89203ed96e02b6bb6e7 WatchSource:0}: Error finding container 5f1cad2951ad11c5489a98887937891ea04a1c48bd4be89203ed96e02b6bb6e7: Status 404 returned error can't find the container with id 5f1cad2951ad11c5489a98887937891ea04a1c48bd4be89203ed96e02b6bb6e7
Oct 30 21:48:48.242721 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.242642    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:48:48.249385 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:48.249354    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac1d726e_b757_46f2_b4a4_988df9fbacef.slice/crio-643b93fcf7bf1855a88005795298b6040c806790147a1d19a63671ab204d6dda WatchSource:0}: Error finding container 643b93fcf7bf1855a88005795298b6040c806790147a1d19a63671ab204d6dda: Status 404 returned error can't find the container with id 643b93fcf7bf1855a88005795298b6040c806790147a1d19a63671ab204d6dda
Oct 30 21:48:48.359877 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.359844    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xzghp"]
Oct 30 21:48:48.366272 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:48.366241    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ab7af8_bde2_475a_8077_051735a3f3a2.slice/crio-147ababa286c8f0cea74cd5e989596575e1c0a9440ec8bd7ceb64012b8479e68 WatchSource:0}: Error finding container 147ababa286c8f0cea74cd5e989596575e1c0a9440ec8bd7ceb64012b8479e68: Status 404 returned error can't find the container with id 147ababa286c8f0cea74cd5e989596575e1c0a9440ec8bd7ceb64012b8479e68
Oct 30 21:48:48.460422 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:48.460389    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-4jbjt"]
Oct 30 21:48:48.466616 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:48:48.466590    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf347f2c6_60fb_48b2_8fd9_11e9305a4b0b.slice/crio-1ecb9d6f464b0342224e89845e88cc6b133993f0ab6a02922d7e605e549a8949 WatchSource:0}: Error finding container 1ecb9d6f464b0342224e89845e88cc6b133993f0ab6a02922d7e605e549a8949: Status 404 returned error can't find the container with id 1ecb9d6f464b0342224e89845e88cc6b133993f0ab6a02922d7e605e549a8949
Oct 30 21:48:49.062356 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:49.062320    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp" event={"ID":"69ab7af8-bde2-475a-8077-051735a3f3a2","Type":"ContainerStarted","Data":"147ababa286c8f0cea74cd5e989596575e1c0a9440ec8bd7ceb64012b8479e68"}
Oct 30 21:48:49.063764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:49.063732    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" event={"ID":"ac1d726e-b757-46f2-b4a4-988df9fbacef","Type":"ContainerStarted","Data":"643b93fcf7bf1855a88005795298b6040c806790147a1d19a63671ab204d6dda"}
Oct 30 21:48:49.065358 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:49.065334    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-4jbjt" event={"ID":"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b","Type":"ContainerStarted","Data":"1ecb9d6f464b0342224e89845e88cc6b133993f0ab6a02922d7e605e549a8949"}
Oct 30 21:48:49.066420 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:49.066398    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff" event={"ID":"a119f87c-e73c-42f5-a012-fbe11436e92f","Type":"ContainerStarted","Data":"5f1cad2951ad11c5489a98887937891ea04a1c48bd4be89203ed96e02b6bb6e7"}
Oct 30 21:48:52.089701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.089606    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp" event={"ID":"69ab7af8-bde2-475a-8077-051735a3f3a2","Type":"ContainerStarted","Data":"cf06e4490c63d7482444fb7cf95cbbe10746f464bde3146223e32278c87faa52"}
Oct 30 21:48:52.090156 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.089703    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:48:52.091897 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.091793    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" event={"ID":"ac1d726e-b757-46f2-b4a4-988df9fbacef","Type":"ContainerStarted","Data":"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"}
Oct 30 21:48:52.091897 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.091859    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:48:52.093468 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.093437    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff" event={"ID":"a119f87c-e73c-42f5-a012-fbe11436e92f","Type":"ContainerStarted","Data":"c2ddb0648c4143780b9250394fd980ba88ad01ee9b4e34dea1d9082702048923"}
Oct 30 21:48:52.093726 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.093707    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:48:52.199022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.198963    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp" podStartSLOduration=1.8170783130000001 podStartE2EDuration="5.198944509s" totalImagesPullingTime="3.381866196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:52.19795616 +0000 UTC m=+337.167802566" watchObservedRunningTime="2026-10-30 21:48:52.198944509 +0000 UTC m=+337.168790921"
Oct 30 21:48:52.307538 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.307468    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff" podStartSLOduration=1.715315175 podStartE2EDuration="5.307450859s" totalImagesPullingTime="3.592135684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:52.306794227 +0000 UTC m=+337.276640637" watchObservedRunningTime="2026-10-30 21:48:52.307450859 +0000 UTC m=+337.277297270"
Oct 30 21:48:52.416471 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:52.416399    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" podStartSLOduration=1.8403104369999999 podStartE2EDuration="5.416383734s" totalImagesPullingTime="3.576073297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:52.414509273 +0000 UTC m=+337.384355682" watchObservedRunningTime="2026-10-30 21:48:52.416383734 +0000 UTC m=+337.386230187"
Oct 30 21:48:53.100938 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:53.100811    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-4jbjt" event={"ID":"f347f2c6-60fb-48b2-8fd9-11e9305a4b0b","Type":"ContainerStarted","Data":"be6f8ef595558d3cb0e7c9f8add621281f5c30041c7eb01912ad766c5ad70433"}
Oct 30 21:48:53.101336 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:53.101245    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:48:53.209289 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:53.209227    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-4jbjt" podStartSLOduration=1.927533765 podStartE2EDuration="6.209213322s" totalImagesPullingTime="4.281679557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:53.208582739 +0000 UTC m=+338.178429147" watchObservedRunningTime="2026-10-30 21:48:53.209213322 +0000 UTC m=+338.179059724"
Oct 30 21:48:56.046091 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:56.046055    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:58.057635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.057602    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 21:48:58.214827 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.214792    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:48:58.215044 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.215012    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" podUID="a6614075-e625-4182-b031-3f696068eeba" containerName="manager" containerID="cri-o://63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a" gracePeriod=30
Oct 30 21:48:58.465196 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.465172    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:58.590431 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.590350    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\") pod \"a6614075-e625-4182-b031-3f696068eeba\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") "
Oct 30 21:48:58.590431 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.590402    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\" (UniqueName: \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\") pod \"a6614075-e625-4182-b031-3f696068eeba\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") "
Oct 30 21:48:58.590643 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.590452    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\") pod \"a6614075-e625-4182-b031-3f696068eeba\" (UID: \"a6614075-e625-4182-b031-3f696068eeba\") "
Oct 30 21:48:58.592631 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.592591    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert" pod "a6614075-e625-4182-b031-3f696068eeba" (UID: "a6614075-e625-4182-b031-3f696068eeba"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:58.592759 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.592605    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs" pod "a6614075-e625-4182-b031-3f696068eeba" (UID: "a6614075-e625-4182-b031-3f696068eeba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:58.592759 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.592706    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx" pod "a6614075-e625-4182-b031-3f696068eeba" (UID: "a6614075-e625-4182-b031-3f696068eeba"). InnerVolumeSpecName "kube-api-access-k8wkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:58.691406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.691369    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:48:58.691406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.691401    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8wkx\" (UniqueName: \"kubernetes.io/projected/a6614075-e625-4182-b031-3f696068eeba-kube-api-access-k8wkx\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:48:58.691406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:58.691411    5579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6614075-e625-4182-b031-3f696068eeba-webhook-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:48:59.133662 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.133625    5579 generic.go:356] "Generic (PLEG): container finished" podID="a6614075-e625-4182-b031-3f696068eeba" containerID="63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a" exitCode=0
Oct 30 21:48:59.134175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.133674    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-k9c8n"
Oct 30 21:48:59.134175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.133710    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" event={"ID":"a6614075-e625-4182-b031-3f696068eeba","Type":"ContainerDied","Data":"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"}
Oct 30 21:48:59.134175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.133774    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-k9c8n" event={"ID":"a6614075-e625-4182-b031-3f696068eeba","Type":"ContainerDied","Data":"a2195c8425c6e8d5cfb1426af3d0b5597916edd72fa203371b391c5d2f055303"}
Oct 30 21:48:59.134175 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.133806    5579 scope.go:122] "RemoveContainer" containerID="63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"
Oct 30 21:48:59.148689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.148664    5579 scope.go:122] "RemoveContainer" containerID="63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"
Oct 30 21:48:59.148991 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:48:59.148970    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a\": container with ID starting with 63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a not found: ID does not exist" containerID="63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"
Oct 30 21:48:59.149069 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.149001    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a"} err="failed to get container status \"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a\": rpc error: code = NotFound desc = could not find container \"63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a\": container with ID starting with 63274ef4c34caa05bd1eeba6fe03664a1b601f8995171f758cc9bd399af1b70a not found: ID does not exist"
Oct 30 21:48:59.286333 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.286293    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:48:59.333198 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:48:59.333160    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-k9c8n"]
Oct 30 21:49:01.144595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:01.144562    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6614075-e625-4182-b031-3f696068eeba" path="/var/lib/kubelet/pods/a6614075-e625-4182-b031-3f696068eeba/volumes"
Oct 30 21:49:03.105591 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:03.105560    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-xzghp"
Oct 30 21:49:05.114256 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:05.114223    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-4jbjt"
Oct 30 21:49:12.930290 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:49:12.930244    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:49:18.931190 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.931150    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:18.931640 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.931510    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a6614075-e625-4182-b031-3f696068eeba" containerName="manager"
Oct 30 21:49:18.931640 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.931520    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6614075-e625-4182-b031-3f696068eeba" containerName="manager"
Oct 30 21:49:18.931640 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.931597    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6614075-e625-4182-b031-3f696068eeba" containerName="manager"
Oct 30 21:49:18.937761 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.937737    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:18.961659 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.961631    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:18.961785 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.961685    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:18.961826 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.961796    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:18.961865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:18.961822    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk4qb\" (UniqueName: \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.032970 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.032917    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rsvrw\""
Oct 30 21:49:19.032970 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.032941    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 21:49:19.032970 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.032970    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:49:19.035346 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.035320    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:19.063239 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.063193    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.063443 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.063267    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.063443 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.063425    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk4qb\" (UniqueName: \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.063610 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.063473    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.064121 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.064099    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.065676 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.065658    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.065730 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.065701    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.118768 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.118732    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk4qb\" (UniqueName: \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\") pod \"maas-api-6d669c7fcd-j6wqs\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.250459 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.250385    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:19.618667 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:19.618583    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:19.624844 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:49:19.624817    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a7a71d_bbbf_4554_9886_ec5e2a756895.slice/crio-6d3407fe685392f903e15ef44091e95ad9247188095728e2556b18707ba54b04 WatchSource:0}: Error finding container 6d3407fe685392f903e15ef44091e95ad9247188095728e2556b18707ba54b04: Status 404 returned error can't find the container with id 6d3407fe685392f903e15ef44091e95ad9247188095728e2556b18707ba54b04
Oct 30 21:49:20.242572 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:20.242529    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" event={"ID":"36a7a71d-bbbf-4554-9886-ec5e2a756895","Type":"ContainerStarted","Data":"6d3407fe685392f903e15ef44091e95ad9247188095728e2556b18707ba54b04"}
Oct 30 21:49:22.254728 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:22.254688    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" event={"ID":"36a7a71d-bbbf-4554-9886-ec5e2a756895","Type":"ContainerStarted","Data":"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"}
Oct 30 21:49:22.255151 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:22.254751    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:22.363491 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:22.363439    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" podStartSLOduration=2.342615489 podStartE2EDuration="4.363425916s" totalImagesPullingTime="2.020810427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:22.362394773 +0000 UTC m=+367.332241182" watchObservedRunningTime="2026-10-30 21:49:22.363425916 +0000 UTC m=+367.333272324"
Oct 30 21:49:23.103129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:23.103096    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:49:23.106133 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:23.106106    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-qxzff"
Oct 30 21:49:28.267978 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:28.267890    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:31.721606 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.721571    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"]
Oct 30 21:49:31.724354 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.724329    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.774065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.774028    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d6th4\""
Oct 30 21:49:31.774065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.774028    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:49:31.782296 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782273    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782417 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782301    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782417 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782330    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782417 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782355    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-kube-api-access-ltjqs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782543 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782508    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782580 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782553    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c709a8ea-0fca-4747-b509-065c9ae96348-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782641 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782621    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782706 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782687    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.782743 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.782721    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c709a8ea-0fca-4747-b509-065c9ae96348-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.883984 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.883922    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-kube-api-access-ltjqs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884009    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884032    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c709a8ea-0fca-4747-b509-065c9ae96348-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884048    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884107    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884140    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c709a8ea-0fca-4747-b509-065c9ae96348-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884433 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884175    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884433 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884201    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884433 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884308    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884538    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884648 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884597    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884703 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884667    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884764 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884698    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.884866 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.884845    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c709a8ea-0fca-4747-b509-065c9ae96348-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.886686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.886662    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c709a8ea-0fca-4747-b509-065c9ae96348-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.886877 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.886858    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c709a8ea-0fca-4747-b509-065c9ae96348-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.945482 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.945445    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjqs\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-kube-api-access-ltjqs\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:31.945956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.945913    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"]
Oct 30 21:49:31.948095 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:31.948041    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c709a8ea-0fca-4747-b509-065c9ae96348-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-bqvsj\" (UID: \"c709a8ea-0fca-4747-b509-065c9ae96348\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:32.036147 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:32.036056    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:32.456591 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:32.456554    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"]
Oct 30 21:49:32.462368 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:49:32.462338    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc709a8ea_0fca_4747_b509_065c9ae96348.slice/crio-103c897c3d26703bf59ed8b362b554039a8091bceca38375c6170caa3f7fe38d WatchSource:0}: Error finding container 103c897c3d26703bf59ed8b362b554039a8091bceca38375c6170caa3f7fe38d: Status 404 returned error can't find the container with id 103c897c3d26703bf59ed8b362b554039a8091bceca38375c6170caa3f7fe38d
Oct 30 21:49:33.316420 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:33.316383    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" event={"ID":"c709a8ea-0fca-4747-b509-065c9ae96348","Type":"ContainerStarted","Data":"103c897c3d26703bf59ed8b362b554039a8091bceca38375c6170caa3f7fe38d"}
Oct 30 21:49:36.577465 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:36.577430    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:49:36.577779 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:36.577508    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:49:36.577779 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:36.577543    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:49:37.353406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:37.353363    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" event={"ID":"c709a8ea-0fca-4747-b509-065c9ae96348","Type":"ContainerStarted","Data":"6387c07e634d9012794652a2ed75bde7c1ffb9ac23cc1c3487f5a2e717d2b2d6"}
Oct 30 21:49:37.513482 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:37.513423    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podStartSLOduration=2.401433373 podStartE2EDuration="6.513409311s" totalImagesPullingTime="4.111975938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:37.512409254 +0000 UTC m=+382.482255664" watchObservedRunningTime="2026-10-30 21:49:37.513409311 +0000 UTC m=+382.483255720"
Oct 30 21:49:38.045042 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:38.044997    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:38.045607 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:38.045235    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-bqvsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:49:38.045754 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:38.045723    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podUID="c709a8ea-0fca-4747-b509-065c9ae96348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 30 21:49:39.040416 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.040381    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-bqvsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:49:39.040708 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.040680    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podUID="c709a8ea-0fca-4747-b509-065c9ae96348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 30 21:49:39.477418 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.477384    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 21:49:39.481185 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.481158    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.570577 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.570543    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.570740 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.570598    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.570832 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.570734    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d48hr\" (UniqueName: \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.570832 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.570765    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.582698 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.582673    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 21:49:39.671546 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.671509    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.671736 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.671556    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.671736 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.671639    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d48hr\" (UniqueName: \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.671828 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.671767    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.672327 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.672303    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.674041 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.674017    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.674224 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.674203    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.747745 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.747670    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d48hr\" (UniqueName: \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\") pod \"maas-api-797f8b87df-xqw8p\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") " pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:39.794593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:39.794560    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:40.044003 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:40.039561    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-bqvsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:49:40.044003 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:40.039635    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podUID="c709a8ea-0fca-4747-b509-065c9ae96348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 30 21:49:40.188768 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:40.188733    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 21:49:40.194506 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:49:40.194470    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc2cbca_07e7_4857_b075_31eaba6eabc5.slice/crio-b2bb1fc842449c2cdc0a47f818f53d4779d36ecc8ea7a8b0a095b9197c873969 WatchSource:0}: Error finding container b2bb1fc842449c2cdc0a47f818f53d4779d36ecc8ea7a8b0a095b9197c873969: Status 404 returned error can't find the container with id b2bb1fc842449c2cdc0a47f818f53d4779d36ecc8ea7a8b0a095b9197c873969
Oct 30 21:49:40.370393 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:40.370303    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" event={"ID":"5bc2cbca-07e7-4857-b075-31eaba6eabc5","Type":"ContainerStarted","Data":"b2bb1fc842449c2cdc0a47f818f53d4779d36ecc8ea7a8b0a095b9197c873969"}
Oct 30 21:49:41.037468 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:41.037429    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-bqvsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:49:41.038120 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:41.038079    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podUID="c709a8ea-0fca-4747-b509-065c9ae96348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 30 21:49:41.379771 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:41.379673    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" event={"ID":"5bc2cbca-07e7-4857-b075-31eaba6eabc5","Type":"ContainerStarted","Data":"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"}
Oct 30 21:49:41.379771 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:41.379750    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:42.043953 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:42.043406    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-bqvsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:49:42.043953 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:42.043470    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj" podUID="c709a8ea-0fca-4747-b509-065c9ae96348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 30 21:49:42.928661 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:49:42.928625    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:49:43.040294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:43.040266    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:43.040568 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:43.040546    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:43.041172 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:43.041151    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bqvsj"
Oct 30 21:49:43.207308 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:43.207201    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" podStartSLOduration=3.3264461069999998 podStartE2EDuration="4.20718653s" totalImagesPullingTime="880.740423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:41.538027064 +0000 UTC m=+386.507873502" watchObservedRunningTime="2026-10-30 21:49:43.20718653 +0000 UTC m=+388.177032940"
Oct 30 21:49:47.391060 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.391034    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 21:49:47.551355 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.551318    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:47.551584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.551555    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" podUID="36a7a71d-bbbf-4554-9886-ec5e2a756895" containerName="maas-api" containerID="cri-o://da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85" gracePeriod=30
Oct 30 21:49:47.800599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.800576    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:47.949244 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.949162    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\" (UniqueName: \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\") pod \"36a7a71d-bbbf-4554-9886-ec5e2a756895\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") "
Oct 30 21:49:47.949408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.949264    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\") pod \"36a7a71d-bbbf-4554-9886-ec5e2a756895\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") "
Oct 30 21:49:47.949408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.949308    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\") pod \"36a7a71d-bbbf-4554-9886-ec5e2a756895\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") "
Oct 30 21:49:47.949408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.949368    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\") pod \"36a7a71d-bbbf-4554-9886-ec5e2a756895\" (UID: \"36a7a71d-bbbf-4554-9886-ec5e2a756895\") "
Oct 30 21:49:47.949744 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.949712    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca" pod "36a7a71d-bbbf-4554-9886-ec5e2a756895" (UID: "36a7a71d-bbbf-4554-9886-ec5e2a756895"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:47.951705 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.951670    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls" pod "36a7a71d-bbbf-4554-9886-ec5e2a756895" (UID: "36a7a71d-bbbf-4554-9886-ec5e2a756895"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:47.951829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.951751    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb" pod "36a7a71d-bbbf-4554-9886-ec5e2a756895" (UID: "36a7a71d-bbbf-4554-9886-ec5e2a756895"). InnerVolumeSpecName "kube-api-access-fk4qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:47.951904 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:47.951838    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs" pod "36a7a71d-bbbf-4554-9886-ec5e2a756895" (UID: "36a7a71d-bbbf-4554-9886-ec5e2a756895"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:48.050592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.050558    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:49:48.050592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.050589    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk4qb\" (UniqueName: \"kubernetes.io/projected/36a7a71d-bbbf-4554-9886-ec5e2a756895-kube-api-access-fk4qb\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:49:48.050592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.050600    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a7a71d-bbbf-4554-9886-ec5e2a756895-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:49:48.050823 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.050609    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a7a71d-bbbf-4554-9886-ec5e2a756895-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:49:48.416692 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.416658    5579 generic.go:356] "Generic (PLEG): container finished" podID="36a7a71d-bbbf-4554-9886-ec5e2a756895" containerID="da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85" exitCode=0
Oct 30 21:49:48.417113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.416708    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"
Oct 30 21:49:48.417113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.416741    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" event={"ID":"36a7a71d-bbbf-4554-9886-ec5e2a756895","Type":"ContainerDied","Data":"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"}
Oct 30 21:49:48.417113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.416796    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs" event={"ID":"36a7a71d-bbbf-4554-9886-ec5e2a756895","Type":"ContainerDied","Data":"6d3407fe685392f903e15ef44091e95ad9247188095728e2556b18707ba54b04"}
Oct 30 21:49:48.417113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.416820    5579 scope.go:122] "RemoveContainer" containerID="da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"
Oct 30 21:49:48.426396 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.426375    5579 scope.go:122] "RemoveContainer" containerID="da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"
Oct 30 21:49:48.426684 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:49:48.426665    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85\": container with ID starting with da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85 not found: ID does not exist" containerID="da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"
Oct 30 21:49:48.426730 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.426694    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85"} err="failed to get container status \"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85\": rpc error: code = NotFound desc = could not find container \"da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85\": container with ID starting with da09fe68c27e9c93fec8aa255a66889e638477b36e492f2550461d9829e15a85 not found: ID does not exist"
Oct 30 21:49:48.578114 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.578080    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:48.624002 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:48.623967    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-j6wqs"]
Oct 30 21:49:49.145060 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:49:49.145027    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36a7a71d-bbbf-4554-9886-ec5e2a756895" path="/var/lib/kubelet/pods/36a7a71d-bbbf-4554-9886-ec5e2a756895/volumes"
Oct 30 21:50:03.981142 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:03.981109    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"]
Oct 30 21:50:03.981619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:03.981519    5579 cpu_manager.go:414] "containerMap: removing container" podUID="36a7a71d-bbbf-4554-9886-ec5e2a756895" containerName="maas-api"
Oct 30 21:50:03.981619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:03.981533    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36a7a71d-bbbf-4554-9886-ec5e2a756895" containerName="maas-api"
Oct 30 21:50:03.981619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:03.981600    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="36a7a71d-bbbf-4554-9886-ec5e2a756895" containerName="maas-api"
Oct 30 21:50:03.984805 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:03.984784    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.045236 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.045201    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"]
Oct 30 21:50:04.094179 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.094139    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bqq7\" (UniqueName: \"kubernetes.io/projected/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-kube-api-access-5bqq7\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.094365 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.094265    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-cert\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.195463 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.195408    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-cert\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.195655 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.195508    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bqq7\" (UniqueName: \"kubernetes.io/projected/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-kube-api-access-5bqq7\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.197803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.197773    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-cert\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.249655 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.249579    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bqq7\" (UniqueName: \"kubernetes.io/projected/87ba9dc9-17a1-4361-9f75-d91c72e1d7d1-kube-api-access-5bqq7\") pod \"llmisvc-controller-manager-6466c554d8-w78lq\" (UID: \"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.298686 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.298645    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:04.665902 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:04.665869    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"]
Oct 30 21:50:04.672489 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:50:04.672462    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ba9dc9_17a1_4361_9f75_d91c72e1d7d1.slice/crio-e33131109ae7c1b6aaaa555dd192ad8b9bbca852d3f7485074d1b0f22b08c6da WatchSource:0}: Error finding container e33131109ae7c1b6aaaa555dd192ad8b9bbca852d3f7485074d1b0f22b08c6da: Status 404 returned error can't find the container with id e33131109ae7c1b6aaaa555dd192ad8b9bbca852d3f7485074d1b0f22b08c6da
Oct 30 21:50:05.509756 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:05.509716    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq" event={"ID":"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1","Type":"ContainerStarted","Data":"8d829cdcfeb7dd0f6d3f52a1c2a9cb0ab259f4782ee04f712f40ab25ade2ca17"}
Oct 30 21:50:05.510271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:05.509803    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq" event={"ID":"87ba9dc9-17a1-4361-9f75-d91c72e1d7d1","Type":"ContainerStarted","Data":"e33131109ae7c1b6aaaa555dd192ad8b9bbca852d3f7485074d1b0f22b08c6da"}
Oct 30 21:50:05.510271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:05.509854    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:05.623269 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:05.623210    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq" podStartSLOduration=1.877847317 podStartE2EDuration="2.623195822s" totalImagesPullingTime="745.348505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:05.621140561 +0000 UTC m=+410.590986969" watchObservedRunningTime="2026-10-30 21:50:05.623195822 +0000 UTC m=+410.593042231"
Oct 30 21:50:12.929268 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:50:12.929231    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:50:36.517792 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.517759    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-w78lq"
Oct 30 21:50:36.672244 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.672215    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:50:36.672446 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.672410    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" podUID="ac1d726e-b757-46f2-b4a4-988df9fbacef" containerName="manager" containerID="cri-o://e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0" gracePeriod=30
Oct 30 21:50:36.917715 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.917691    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:50:36.998022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.997988    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\" (UniqueName: \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\") pod \"ac1d726e-b757-46f2-b4a4-988df9fbacef\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") "
Oct 30 21:50:36.998183 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:36.998033    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\" (UniqueName: \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\") pod \"ac1d726e-b757-46f2-b4a4-988df9fbacef\" (UID: \"ac1d726e-b757-46f2-b4a4-988df9fbacef\") "
Oct 30 21:50:37.000050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.000026    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b" pod "ac1d726e-b757-46f2-b4a4-988df9fbacef" (UID: "ac1d726e-b757-46f2-b4a4-988df9fbacef"). InnerVolumeSpecName "kube-api-access-8287b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:37.000131 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.000110    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert" pod "ac1d726e-b757-46f2-b4a4-988df9fbacef" (UID: "ac1d726e-b757-46f2-b4a4-988df9fbacef"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:50:37.099331 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.099249    5579 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1d726e-b757-46f2-b4a4-988df9fbacef-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:50:37.099331 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.099278    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8287b\" (UniqueName: \"kubernetes.io/projected/ac1d726e-b757-46f2-b4a4-988df9fbacef-kube-api-access-8287b\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 21:50:37.678214 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.678178    5579 generic.go:356] "Generic (PLEG): container finished" podID="ac1d726e-b757-46f2-b4a4-988df9fbacef" containerID="e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0" exitCode=0
Oct 30 21:50:37.678699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.678237    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"
Oct 30 21:50:37.678699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.678258    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" event={"ID":"ac1d726e-b757-46f2-b4a4-988df9fbacef","Type":"ContainerDied","Data":"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"}
Oct 30 21:50:37.678699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.678310    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg" event={"ID":"ac1d726e-b757-46f2-b4a4-988df9fbacef","Type":"ContainerDied","Data":"643b93fcf7bf1855a88005795298b6040c806790147a1d19a63671ab204d6dda"}
Oct 30 21:50:37.678699 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.678331    5579 scope.go:122] "RemoveContainer" containerID="e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"
Oct 30 21:50:37.690116 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.690093    5579 scope.go:122] "RemoveContainer" containerID="e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"
Oct 30 21:50:37.690413 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:50:37.690386    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0\": container with ID starting with e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0 not found: ID does not exist" containerID="e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"
Oct 30 21:50:37.690490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.690416    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0"} err="failed to get container status \"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0\": rpc error: code = NotFound desc = could not find container \"e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0\": container with ID starting with e6bdf0452ea2135685864a6b65e6ba54eb51925b68356ba14aa46a9a108c62e0 not found: ID does not exist"
Oct 30 21:50:37.851662 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.851605    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:50:37.897944 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:37.897906    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6xsvg"]
Oct 30 21:50:39.144767 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:50:39.144738    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac1d726e-b757-46f2-b4a4-988df9fbacef" path="/var/lib/kubelet/pods/ac1d726e-b757-46f2-b4a4-988df9fbacef/volumes"
Oct 30 21:50:42.931921 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:50:42.931883    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:51:12.930209 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:51:12.930121    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:51:17.565044 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.564999    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 21:51:17.565567 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.565361    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ac1d726e-b757-46f2-b4a4-988df9fbacef" containerName="manager"
Oct 30 21:51:17.565567 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.565372    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac1d726e-b757-46f2-b4a4-988df9fbacef" containerName="manager"
Oct 30 21:51:17.565567 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.565459    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac1d726e-b757-46f2-b4a4-988df9fbacef" containerName="manager"
Oct 30 21:51:17.569959 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.569913    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.670868 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.670834    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 21:51:17.679138 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679104    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679316 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679232    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679390 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679333    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679451 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679405    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679451 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679432    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679561 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679508    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8p2\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679646 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679562    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679646 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679591    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.679762 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.679650    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780137 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780100    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780157    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780179    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780220    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8p2\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780256    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780279    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780302    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780338 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780333    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780691 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780388    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780691 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780668    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780768    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780787    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780892 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780863    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.780985 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.780962    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.782547 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.782525    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.782758 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.782740    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.835496 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.835420    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.835657 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.835531    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8p2\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\") pod \"maas-default-gateway-openshift-default-694db55c87-xxmhg\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:17.883399 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:17.883360    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:18.309595 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.309560    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 21:51:18.315569 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:51:18.315540    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1a9bed_57e0_465c_9260_0ddc30ced7e1.slice/crio-40f69ec20450f984dc639c2c5b6bfbb06c2fd3b4defc53901603e595a93045bb WatchSource:0}: Error finding container 40f69ec20450f984dc639c2c5b6bfbb06c2fd3b4defc53901603e595a93045bb: Status 404 returned error can't find the container with id 40f69ec20450f984dc639c2c5b6bfbb06c2fd3b4defc53901603e595a93045bb
Oct 30 21:51:18.317663 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.317631    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:18.317742 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.317697    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:18.317778 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.317748    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:18.897351 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.897306    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" event={"ID":"5f1a9bed-57e0-465c-9260-0ddc30ced7e1","Type":"ContainerStarted","Data":"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"}
Oct 30 21:51:18.897749 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:18.897368    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" event={"ID":"5f1a9bed-57e0-465c-9260-0ddc30ced7e1","Type":"ContainerStarted","Data":"40f69ec20450f984dc639c2c5b6bfbb06c2fd3b4defc53901603e595a93045bb"}
Oct 30 21:51:19.015045 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:19.014994    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podStartSLOduration=2.014981172 podStartE2EDuration="2.014981172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:19.013632637 +0000 UTC m=+483.983479046" watchObservedRunningTime="2026-10-30 21:51:19.014981172 +0000 UTC m=+483.984827580"
Oct 30 21:51:19.883840 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:19.883808    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:19.885779 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:19.885751    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:19.885960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:19.885796    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:20.884090 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:20.884054    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:20.884517 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:20.884109    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:21.885241 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:21.885195    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:21.885680 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:21.885277    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:22.884547 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:22.884506    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:22.884730 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:22.884566    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:23.884113 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:23.884073    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:23.884604 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:23.884151    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:24.884408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:24.884372    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-xxmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:51:24.884845 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:24.884431    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Oct 30 21:51:25.888106 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:25.888070    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:25.888498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:25.888327    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:25.888998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:25.888983    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 21:51:32.690923 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.690889    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 21:51:32.694704 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.694679    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755601 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755552    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755662    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755702    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755718    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nkv\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755795 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755747    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755837    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755883    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.755981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.755915    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.756193 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.756061    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857379 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857343    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857391    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857415    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857436    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nkv\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857474    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857505    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857554 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857541    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857876 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857582    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.857876 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857643    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.858010 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857867    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.858010 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.857972    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.858363 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.858329    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.858530 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.858499    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.858652 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.858515    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.860707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.860677    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.860904 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.860883    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.915057 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.915026    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 21:51:32.915239 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.915055    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:32.918632 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:32.918595    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nkv\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\") pod \"maas-default-gateway-openshift-default-694db55c87-zwwt2\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:33.008516 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:33.008429    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:33.434188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:33.434144    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 21:51:33.478218 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:51:33.478185    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06942da6_66eb_4de2_b3bb_21d505fb8732.slice/crio-eb1a9f7f27ca8f8fd13d7196dc97d31a7e632d54291863f7bad347af3598201d WatchSource:0}: Error finding container eb1a9f7f27ca8f8fd13d7196dc97d31a7e632d54291863f7bad347af3598201d: Status 404 returned error can't find the container with id eb1a9f7f27ca8f8fd13d7196dc97d31a7e632d54291863f7bad347af3598201d
Oct 30 21:51:33.480380 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:33.480352    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:33.480455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:33.480420    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:33.480455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:33.480448    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:51:34.007402 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.007358    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" event={"ID":"06942da6-66eb-4de2-b3bb-21d505fb8732","Type":"ContainerStarted","Data":"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"}
Oct 30 21:51:34.007902 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.007446    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" event={"ID":"06942da6-66eb-4de2-b3bb-21d505fb8732","Type":"ContainerStarted","Data":"eb1a9f7f27ca8f8fd13d7196dc97d31a7e632d54291863f7bad347af3598201d"}
Oct 30 21:51:34.008668 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.008646    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:34.010311 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.010286    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:34.010448 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.010334    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:34.205080 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:34.205021    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podStartSLOduration=2.205006134 podStartE2EDuration="2.205006134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:34.168014638 +0000 UTC m=+499.137861046" watchObservedRunningTime="2026-10-30 21:51:34.205006134 +0000 UTC m=+499.174852542"
Oct 30 21:51:35.009217 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:35.009184    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:35.009709 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:35.009253    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:36.009619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:36.009124    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:36.009619 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:36.009188    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:37.009444 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:37.009401    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:37.009658 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:37.009458    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:38.009564 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:38.009529    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:38.009752 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:38.009587    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:39.009394 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:39.009358    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:39.009584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:39.009418    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:40.009753 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:40.009708    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 21:51:40.010173 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:40.009779    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 21:51:42.010562 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:42.010508    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:51:42.011111 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:42.010590    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:51:42.932467 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:51:42.932423    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:51:43.051202 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:43.051155    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zwwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:51:43.051766 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:43.051251    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:51:43.586962 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:43.586916    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:43.587239 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:43.587218    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:51:43.587887 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:51:43.587869    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 21:52:12.929891 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:52:12.929849    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:52:42.930098 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:52:42.930016    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:52:59.585139 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.585103    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 21:52:59.588503 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.588480    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.689748 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.689715    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-5402dd-serving-cert\""
Oct 30 21:52:59.691981 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.691952    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 21:52:59.725566 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.725519    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.725729 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.725586    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.725785 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.725744    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.725839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.725798    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskjl\" (UniqueName: \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.827406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.827373    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.827581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.827455    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.827581 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.827496    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskjl\" (UniqueName: \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.827734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.827583    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.827734 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:52:59.827638    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-serving-cert: secret "maas-api-e2e-worker-w5-5402dd-serving-cert" not found
Oct 30 21:52:59.827821 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:52:59.827742    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls podName:22c18022-1ea1-40c1-9a89-57f3b9e1f959 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.327718202 +0000 UTC m=+585.297564620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls") pod "maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" (UID: "22c18022-1ea1-40c1-9a89-57f3b9e1f959") : secret "maas-api-e2e-worker-w5-5402dd-serving-cert" not found
Oct 30 21:52:59.828249 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.828224    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.830011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.829987    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:52:59.881998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:52:59.881903    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskjl\" (UniqueName: \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:00.332108 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:00.332073    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:00.334568 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:00.334539    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:00.501191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:00.501159    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:00.888555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:00.888518    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 21:53:00.895897 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:53:00.895872    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c18022_1ea1_40c1_9a89_57f3b9e1f959.slice/crio-7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9 WatchSource:0}: Error finding container 7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9: Status 404 returned error can't find the container with id 7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9
Oct 30 21:53:00.897158 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:00.897140    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:53:01.491494 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:01.491456    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" event={"ID":"22c18022-1ea1-40c1-9a89-57f3b9e1f959","Type":"ContainerStarted","Data":"7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9"}
Oct 30 21:53:02.498378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:02.498344    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" event={"ID":"22c18022-1ea1-40c1-9a89-57f3b9e1f959","Type":"ContainerStarted","Data":"a4e30059912ba4a6aa0c43c0ce5fd8cd8abde08b83da532c581b3efaab704da9"}
Oct 30 21:53:02.498776 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:02.498413    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:02.608863 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:02.608813    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" podStartSLOduration=2.772344562 podStartE2EDuration="3.608798782s" totalImagesPullingTime="836.45422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:02.608482009 +0000 UTC m=+587.578328417" watchObservedRunningTime="2026-10-30 21:53:02.608798782 +0000 UTC m=+587.578645190"
Oct 30 21:53:04.481535 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.481498    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 21:53:04.485457 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.485431    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.534776 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.534739    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-a07620-serving-cert\""
Oct 30 21:53:04.574650 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.574612    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.574650 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.574653    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.574919 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.574790    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.574919 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.574849    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w84r\" (UniqueName: \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.583725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.583694    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 21:53:04.676389 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.676351    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w84r\" (UniqueName: \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.676599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.676452    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.676599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.676479    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.676599 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.676560    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.676737 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:04.676687    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-serving-cert: secret "maas-api-e2e-worker-w1-a07620-serving-cert" not found
Oct 30 21:53:04.676780 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:04.676760    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls podName:fb242fc4-737b-42aa-b1da-de7734c10151 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:05.176742722 +0000 UTC m=+590.146589116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls") pod "maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" (UID: "fb242fc4-737b-42aa-b1da-de7734c10151") : secret "maas-api-e2e-worker-w1-a07620-serving-cert" not found
Oct 30 21:53:04.677163 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.677141    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.679142 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.679120    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:04.734412 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:04.734336    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w84r\" (UniqueName: \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:05.182115 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:05.182081    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:05.184593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:05.184559    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:05.399114 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:05.399077    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:05.787383 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:05.787309    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 21:53:05.794792 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:53:05.794756    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb242fc4_737b_42aa_b1da_de7734c10151.slice/crio-63ed69a726c02b6f389c353d01287745a7e6dc083d92208edfcccfb517329377 WatchSource:0}: Error finding container 63ed69a726c02b6f389c353d01287745a7e6dc083d92208edfcccfb517329377: Status 404 returned error can't find the container with id 63ed69a726c02b6f389c353d01287745a7e6dc083d92208edfcccfb517329377
Oct 30 21:53:06.524587 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:06.524549    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" event={"ID":"fb242fc4-737b-42aa-b1da-de7734c10151","Type":"ContainerStarted","Data":"63ed69a726c02b6f389c353d01287745a7e6dc083d92208edfcccfb517329377"}
Oct 30 21:53:07.533477 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:07.533433    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" event={"ID":"fb242fc4-737b-42aa-b1da-de7734c10151","Type":"ContainerStarted","Data":"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"}
Oct 30 21:53:07.533477 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:07.533501    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:07.648846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:07.648789    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" podStartSLOduration=2.654107752 podStartE2EDuration="3.648774378s" totalImagesPullingTime="994.666626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:07.647038612 +0000 UTC m=+592.616885022" watchObservedRunningTime="2026-10-30 21:53:07.648774378 +0000 UTC m=+592.618620787"
Oct 30 21:53:08.510403 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:08.510374    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 21:53:09.601367 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.601334    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 21:53:09.606446 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.606410    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.655860 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.655826    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-f776cb-serving-cert\""
Oct 30 21:53:09.668070 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.668040    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 21:53:09.731880 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.731844    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.732062 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.731888    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvq57\" (UniqueName: \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.732062 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.731913    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.732062 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.731990    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.833068 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.833030    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.833068 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.833072    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvq57\" (UniqueName: \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.833286 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.833092    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.833286 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.833112    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.833739 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.833711    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.835647 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.835625    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.835743 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.835677    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.887370 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.887347    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvq57\" (UniqueName: \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\") pod \"maas-api-e2e-worker-w3-f776cb-7657547797-szhkg\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:09.921905 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:09.921873    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:10.296941 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:10.296838    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 21:53:10.551754 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:10.551645    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" event={"ID":"07f6e2a2-cbce-4913-8ab0-adf61371c969","Type":"ContainerStarted","Data":"9d352c24e73dc12ccd454f17e2e92ab818f6cfe4ef7c45b11c39ba5902f76561"}
Oct 30 21:53:11.558254 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:11.558173    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" event={"ID":"07f6e2a2-cbce-4913-8ab0-adf61371c969","Type":"ContainerStarted","Data":"df02c72c80ed3808a9c23e8a9a4e1ab8fd9f0957f7749445789fb3db5e9c6da3"}
Oct 30 21:53:11.558625 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:11.558271    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:11.670183 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:11.670124    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" podStartSLOduration=1.7631198609999998 podStartE2EDuration="2.670110411s" totalImagesPullingTime="906.99055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:11.6688829 +0000 UTC m=+596.638729309" watchObservedRunningTime="2026-10-30 21:53:11.670110411 +0000 UTC m=+596.639956820"
Oct 30 21:53:12.929398 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:12.929359    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:53:13.543589 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:13.543561    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 21:53:14.592188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.592146    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 21:53:14.595778 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.595752    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.644670 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.644636    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-2d1f91-serving-cert\""
Oct 30 21:53:14.679282 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.679247    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.679282 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.679281    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj772\" (UniqueName: \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.679475 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.679313    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.679475 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.679442    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.693498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.693464    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 21:53:14.783316 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.783276    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.783316 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.783319    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj772\" (UniqueName: \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.783590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.783372    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.783590 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.783399    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.783590 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:14.783485    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-serving-cert: secret "maas-api-e2e-worker-w0-2d1f91-serving-cert" not found
Oct 30 21:53:14.783590 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:14.783564    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls podName:c82ce272-d654-4505-b3e3-b912bdf3d10b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:15.28354102 +0000 UTC m=+600.253387408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls") pod "maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" (UID: "c82ce272-d654-4505-b3e3-b912bdf3d10b") : secret "maas-api-e2e-worker-w0-2d1f91-serving-cert" not found
Oct 30 21:53:14.784137 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.784115    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.785885 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.785856    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:14.837991 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:14.837953    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj772\" (UniqueName: \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:15.289403 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:15.289366    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:15.291801 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:15.291780    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:15.508988 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:15.508955    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:15.880540 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:15.880461    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 21:53:15.886466 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:53:15.886437    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82ce272_d654_4505_b3e3_b912bdf3d10b.slice/crio-ec28695a086f71406adee459653d0c0dade1441fab9df09c16e797ec88870655 WatchSource:0}: Error finding container ec28695a086f71406adee459653d0c0dade1441fab9df09c16e797ec88870655: Status 404 returned error can't find the container with id ec28695a086f71406adee459653d0c0dade1441fab9df09c16e797ec88870655
Oct 30 21:53:16.589348 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:16.589308    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" event={"ID":"c82ce272-d654-4505-b3e3-b912bdf3d10b","Type":"ContainerStarted","Data":"ec28695a086f71406adee459653d0c0dade1441fab9df09c16e797ec88870655"}
Oct 30 21:53:17.569905 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:17.569873    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 21:53:17.596129 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:17.596091    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" event={"ID":"c82ce272-d654-4505-b3e3-b912bdf3d10b","Type":"ContainerStarted","Data":"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"}
Oct 30 21:53:17.596316 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:17.596192    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:17.801565 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:17.801505    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" podStartSLOduration=2.8574118779999997 podStartE2EDuration="3.801489922s" totalImagesPullingTime="944.078044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:17.800110315 +0000 UTC m=+602.769956735" watchObservedRunningTime="2026-10-30 21:53:17.801489922 +0000 UTC m=+602.771336331"
Oct 30 21:53:23.608024 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:23.607988    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 21:53:33.781766 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.781732    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 21:53:33.785817 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.785793    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.835259 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.835225    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-5be0d1-serving-cert\""
Oct 30 21:53:33.867261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.867222    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.867261 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.867276    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b86mq\" (UniqueName: \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.867498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.867359    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.867498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.867488    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.883518 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.883477    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 21:53:33.968526 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.968489    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.968734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.968590    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.968734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.968631    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.968734 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.968655    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b86mq\" (UniqueName: \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.968734 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:33.968667    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-serving-cert: secret "maas-api-e2e-worker-w2-5be0d1-serving-cert" not found
Oct 30 21:53:33.969038 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:33.968745    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls podName:cbf97f98-274f-4242-beee-e462faa43e7a nodeName:}" failed. No retries permitted until 2026-10-30 21:53:34.468724047 +0000 UTC m=+619.438570441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls") pod "maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" (UID: "cbf97f98-274f-4242-beee-e462faa43e7a") : secret "maas-api-e2e-worker-w2-5be0d1-serving-cert" not found
Oct 30 21:53:33.969301 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.969278    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:33.971271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:33.971243    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:34.022750 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:34.022716    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b86mq\" (UniqueName: \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:34.474122 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:34.474083    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:34.476553 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:34.476523    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:34.699506 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:34.699472    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:35.072685 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:35.072608    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 21:53:35.079350 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:53:35.079317    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf97f98_274f_4242_beee_e462faa43e7a.slice/crio-f97ffcd71a229095e10d55ef522bf508f41ffc272a47d782feb93bbd56c95240 WatchSource:0}: Error finding container f97ffcd71a229095e10d55ef522bf508f41ffc272a47d782feb93bbd56c95240: Status 404 returned error can't find the container with id f97ffcd71a229095e10d55ef522bf508f41ffc272a47d782feb93bbd56c95240
Oct 30 21:53:35.693816 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:35.693779    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" event={"ID":"cbf97f98-274f-4242-beee-e462faa43e7a","Type":"ContainerStarted","Data":"f97ffcd71a229095e10d55ef522bf508f41ffc272a47d782feb93bbd56c95240"}
Oct 30 21:53:36.700488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:36.700451    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" event={"ID":"cbf97f98-274f-4242-beee-e462faa43e7a","Type":"ContainerStarted","Data":"1620b4173aae3f62f5d64da957ffde25a15f47fe9154a0df9bd26e0952a6baeb"}
Oct 30 21:53:36.700977 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:36.700534    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:36.813123 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:36.813068    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" podStartSLOduration=2.883547245 podStartE2EDuration="3.81305357s" totalImagesPullingTime="929.506325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:36.811334302 +0000 UTC m=+621.781180713" watchObservedRunningTime="2026-10-30 21:53:36.81305357 +0000 UTC m=+621.782899978"
Oct 30 21:53:42.711209 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:42.711180    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 21:53:42.932897 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:42.932849    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:53:48.472365 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.472333    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 21:53:48.476376 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.476350    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.525294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.525260    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-17d809-serving-cert\""
Oct 30 21:53:48.573916 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.573884    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 21:53:48.620829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.620790    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.621023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.620861    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfjj\" (UniqueName: \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.621023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.621006    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.621170 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.621148    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.722037 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.721996    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.722237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.722110    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.722237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.722141    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.722237 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.722190    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfjj\" (UniqueName: \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.723043 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.722951    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.723043 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:48.723002    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-serving-cert: secret "maas-api-e2e-worker-w4-17d809-serving-cert" not found
Oct 30 21:53:48.723228 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:53:48.723087    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls podName:ea73b814-b74d-4992-b613-08d04dd8f097 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:49.223065435 +0000 UTC m=+634.192911828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls") pod "maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" (UID: "ea73b814-b74d-4992-b613-08d04dd8f097") : secret "maas-api-e2e-worker-w4-17d809-serving-cert" not found
Oct 30 21:53:48.725772 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.725744    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:48.779830 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:48.779795    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfjj\" (UniqueName: \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:49.229477 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:49.229436    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:49.231971 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:49.231917    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") pod \"maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:49.389740 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:49.389699    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:49.768688 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:49.768651    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 21:53:49.774911 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:53:49.774885    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea73b814_b74d_4992_b613_08d04dd8f097.slice/crio-791e57b53841fbfddc18bebfd4b8a369877d931b2b72b714103c455160c104c4 WatchSource:0}: Error finding container 791e57b53841fbfddc18bebfd4b8a369877d931b2b72b714103c455160c104c4: Status 404 returned error can't find the container with id 791e57b53841fbfddc18bebfd4b8a369877d931b2b72b714103c455160c104c4
Oct 30 21:53:50.778146 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:50.778106    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" event={"ID":"ea73b814-b74d-4992-b613-08d04dd8f097","Type":"ContainerStarted","Data":"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"}
Oct 30 21:53:50.778635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:50.778173    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" event={"ID":"ea73b814-b74d-4992-b613-08d04dd8f097","Type":"ContainerStarted","Data":"791e57b53841fbfddc18bebfd4b8a369877d931b2b72b714103c455160c104c4"}
Oct 30 21:53:50.778635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:50.778308    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:53:50.910448 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:50.910397    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" podStartSLOduration=1.991069547 podStartE2EDuration="2.910385443s" totalImagesPullingTime="919.315896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:50.909476934 +0000 UTC m=+635.879323343" watchObservedRunningTime="2026-10-30 21:53:50.910385443 +0000 UTC m=+635.880231851"
Oct 30 21:53:56.790635 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:53:56.790558    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 21:54:12.930285 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:54:12.930244    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:54:42.929866 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:54:42.929823    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:55:12.929660 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:55:12.929619    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:55:42.930543 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:55:42.930458    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:56:12.929742 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:56:12.929699    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:56:37.529641 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.529601    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 21:56:37.533534 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.533513    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.587587 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.587560    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2d1f91-openshift-default-dockercfg-zn7vw\""
Oct 30 21:56:37.632137 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.632098    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 21:56:37.693760 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.693727    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.693760 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.693767    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.693793    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhf5s\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.693873    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.693950    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694055 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.694009    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694252 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.694096    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694252 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.694173    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.694315 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.694254    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795402    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795441    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795462    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhf5s\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795490 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795481    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795518    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795546    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795584    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795651    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.795878 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.795717    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.796174 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.796124    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.796232 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.796200    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.796372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.796346    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.796441 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.796374    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.796441 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.796351    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.797987 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.797963    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.798128 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.798110    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.858592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.858555    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhf5s\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:37.859090 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:37.858673    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:38.146203 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.146175    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:38.575542 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.575454    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 21:56:38.580355 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:56:38.580329    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1f58c7_c792_45b0_b9e8_81725268dd74.slice/crio-1c47a2fc2f998a1483835699f0f689dbd2879eaf38c0babed6b9b33d855dbdd3 WatchSource:0}: Error finding container 1c47a2fc2f998a1483835699f0f689dbd2879eaf38c0babed6b9b33d855dbdd3: Status 404 returned error can't find the container with id 1c47a2fc2f998a1483835699f0f689dbd2879eaf38c0babed6b9b33d855dbdd3
Oct 30 21:56:38.582784 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.582750    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:56:38.582871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.582817    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:56:38.582871 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.582845    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:56:38.718665 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.718625    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" event={"ID":"5a1f58c7-c792-45b0-b9e8-81725268dd74","Type":"ContainerStarted","Data":"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"}
Oct 30 21:56:38.718837 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.718681    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" event={"ID":"5a1f58c7-c792-45b0-b9e8-81725268dd74","Type":"ContainerStarted","Data":"1c47a2fc2f998a1483835699f0f689dbd2879eaf38c0babed6b9b33d855dbdd3"}
Oct 30 21:56:38.832276 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:38.832169    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podStartSLOduration=1.832152644 podStartE2EDuration="1.832152644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:38.830804835 +0000 UTC m=+803.800651254" watchObservedRunningTime="2026-10-30 21:56:38.832152644 +0000 UTC m=+803.801999052"
Oct 30 21:56:39.150822 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:39.150417    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:39.150822 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:39.150489    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:39.152469 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:39.152447    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:40.148286 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:40.148248    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:40.148682 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:40.148313    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:41.147320 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:41.147285    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:41.147541 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:41.147345    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:42.147691 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:42.147648    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:42.148209 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:42.147714    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:42.955044 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:56:42.954990    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:56:43.148006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:43.147502    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:43.148006 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:43.147559    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:44.147385 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:44.147342    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:56:44.147573 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:44.147408    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 21:56:45.323291 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:45.323251    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:45.324194 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:45.324108    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:56:45.325861 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:56:45.325832    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 21:57:12.937211 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:57:12.937111    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:57:42.930763 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:57:42.930719    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:58:12.932278 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:58:12.932231    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:58:21.894735 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.894694    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 21:58:21.898999 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.898965    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.953056 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.953029    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-14af5c-openshift-default-dockercfg-f5mqp\""
Oct 30 21:58:21.991404 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.991366    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.991759 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.991732    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.991853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.991789    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.991908 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.991887    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.992022 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.992000    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spcnf\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.992120 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.992098    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.992216 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.992183    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.992349 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.992223    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.992349 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.992269    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:21.998342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:21.998311    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 21:58:22.093628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.093586    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.093815 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.093656    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.093815 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.093698    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.093962 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.093837    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.093962 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.093944    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spcnf\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094080 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094004    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094080 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094041    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094080 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094052    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094230 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094085    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094230 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094136    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094334 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094318    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094475 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094450    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094552 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094450    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.094552 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.094516    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.096292 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.096262    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.096403 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.096385    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.161095 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.161020    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.167793 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.167765    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spcnf\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.196327 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.196295    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 21:58:22.201525 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.201500    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.217478 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.217441    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:22.250424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.250392    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-f776cb-openshift-default-dockercfg-gj5q6\""
Oct 30 21:58:22.267108 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.267075    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 21:58:22.296205 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296071    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296412 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296275    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296492 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296431    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296555 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296508    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296620 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296602    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296680 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296631    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296752 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296735    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296822    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j47v\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.296907 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.296852    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397700 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397663    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j47v\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397707    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397754    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397793    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397840    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397861    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.397895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397891    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398259 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397915    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398259 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.397974    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398366 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.398300    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398536 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.398478    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398681 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.398653    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398755 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.398682    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.398819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.398763    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.400291 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.400270    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.400424 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.400403    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.451975 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.451874    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.451975 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.451959    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j47v\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.521723 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.521683    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:22.648089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.648044    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 21:58:22.655031 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:58:22.655002    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abe9df3_5680_446a_b468_ac26aea29e91.slice/crio-505658ecba86f3b5682c30d1afd398945039b611932201f264f80275027ce1e9 WatchSource:0}: Error finding container 505658ecba86f3b5682c30d1afd398945039b611932201f264f80275027ce1e9: Status 404 returned error can't find the container with id 505658ecba86f3b5682c30d1afd398945039b611932201f264f80275027ce1e9
Oct 30 21:58:22.657488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.657455    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:22.657584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.657523    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:22.657584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.657551    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:22.904862 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.904825    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 21:58:22.908050 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:58:22.908020    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66bba9d_b54a_470a_8c85_c36d84665167.slice/crio-fe58d3a842175be2d48cc947211b2d95e6378109f1ab5a2c3fe9023f8492e6af WatchSource:0}: Error finding container fe58d3a842175be2d48cc947211b2d95e6378109f1ab5a2c3fe9023f8492e6af: Status 404 returned error can't find the container with id fe58d3a842175be2d48cc947211b2d95e6378109f1ab5a2c3fe9023f8492e6af
Oct 30 21:58:22.910498 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.910463    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:22.910604 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.910549    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:22.910604 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:22.910593    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:23.382751 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.382652    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" event={"ID":"a66bba9d-b54a-470a-8c85-c36d84665167","Type":"ContainerStarted","Data":"5652a91ddecc52d560eb49a6c149596ac2d3ff59a4a9ff90b8c29a5125b462f4"}
Oct 30 21:58:23.382751 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.382716    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" event={"ID":"a66bba9d-b54a-470a-8c85-c36d84665167","Type":"ContainerStarted","Data":"fe58d3a842175be2d48cc947211b2d95e6378109f1ab5a2c3fe9023f8492e6af"}
Oct 30 21:58:23.385340 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.385311    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" event={"ID":"0abe9df3-5680-446a-b468-ac26aea29e91","Type":"ContainerStarted","Data":"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"}
Oct 30 21:58:23.385496 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.385357    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" event={"ID":"0abe9df3-5680-446a-b468-ac26aea29e91","Type":"ContainerStarted","Data":"505658ecba86f3b5682c30d1afd398945039b611932201f264f80275027ce1e9"}
Oct 30 21:58:23.512735 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.512684    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podStartSLOduration=1.512669742 podStartE2EDuration="1.512669742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:23.511344681 +0000 UTC m=+908.481191090" watchObservedRunningTime="2026-10-30 21:58:23.512669742 +0000 UTC m=+908.482516167"
Oct 30 21:58:23.529954 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.521906    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:23.546966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.546079    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:23.546966 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.546143    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:23.653990 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:23.644955    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podStartSLOduration=2.6449193170000003 podStartE2EDuration="2.644919317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:23.643420213 +0000 UTC m=+908.613266636" watchObservedRunningTime="2026-10-30 21:58:23.644919317 +0000 UTC m=+908.614765727"
Oct 30 21:58:24.218639 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:24.218603    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:24.220003 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:24.219980    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:24.220068 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:24.220029    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:24.534015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:24.526303    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:24.534015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:24.526359    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:25.218971 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:25.218838    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:25.218971 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:25.218914    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:25.547013 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:25.546387    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:25.547013 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:25.546445    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:26.218648 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:26.218613    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:26.218842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:26.218667    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:26.530014 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:26.526280    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:26.530014 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:26.526343    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:27.218374 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:27.218325    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:27.218563 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:27.218385    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:27.526408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:27.526317    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:27.526669 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:27.526637    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:28.218107 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:28.218069    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:28.218533 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:28.218131    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:28.526313 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:28.526225    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:28.526571 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:28.526538    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:29.217844 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:29.217812    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:58:29.218065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:29.217866    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 21:58:29.523069 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:29.522971    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:58:29.523566 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:29.523083    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 21:58:30.222649 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.222612    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:30.223065 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.223044    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:30.223799 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.223779    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 21:58:30.527889 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.527797    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:30.529915 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.529892    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:30.530071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:30.530060    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 21:58:36.701760 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.701721    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 21:58:36.705536 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.705514    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.727525 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.727496    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 21:58:36.754671 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.754645    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-5402dd-openshift-default-dockercfg-lstcs\""
Oct 30 21:58:36.786829 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.786799    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.786841    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66k5j\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.786878    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.786920    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.786988    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787023 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.787010    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787272 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.787152    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787272 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.787191    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.787342 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.787274    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888552    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888592 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888591    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888615    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888637    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888721    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888742    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.888842 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888801    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888856    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.888892    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66k5j\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.889044    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889322 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.889189    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889322 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.889218    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889322 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.889289    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.889752 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.889732    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.891066 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.891047    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.891453 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.891430    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.942149 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.942117    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66k5j\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:36.942307 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:36.942117    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:37.020252 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.020160    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:37.465097 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.465064    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 21:58:37.469709 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:58:37.469682    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce2dba9_6286_47d6_b53d_d41c3fbcea83.slice/crio-54c88859b5a1b9a4b867b2ed984f881f506ccfe630da240738e924a561207927 WatchSource:0}: Error finding container 54c88859b5a1b9a4b867b2ed984f881f506ccfe630da240738e924a561207927: Status 404 returned error can't find the container with id 54c88859b5a1b9a4b867b2ed984f881f506ccfe630da240738e924a561207927
Oct 30 21:58:37.472071 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.472040    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:37.472173 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.472136    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:37.472241 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.472190    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:37.687081 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.687034    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 21:58:37.691578 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.691545    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697191 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697150    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697353 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697233    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697410 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697349    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697410 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697379    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2bgx\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697416    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697570 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697505    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697622 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697569    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697670 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697644    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.697763 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.697743    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.740906 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.740817    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-17d809-openshift-default-dockercfg-ppc95\""
Oct 30 21:58:37.753865 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.753820    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 21:58:37.798820 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.798779    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.798887    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.798919    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799072    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799117    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799201    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799271 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799254    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799376 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799279    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2bgx\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799376 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799300    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799376 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799313    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799725 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799691    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.799841 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.799817    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.800028 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.800008    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.800133 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.800065    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.801978 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.801913    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.802476 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.802451    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.854650 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.854618    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2bgx\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:37.854650 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:37.854646    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:38.006992 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.006902    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:38.456243 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.456209    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 21:58:38.461872 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.461844    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.474852 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.474822    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" event={"ID":"3ce2dba9-6286-47d6-b53d-d41c3fbcea83","Type":"ContainerStarted","Data":"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"}
Oct 30 21:58:38.475005 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.474873    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" event={"ID":"3ce2dba9-6286-47d6-b53d-d41c3fbcea83","Type":"ContainerStarted","Data":"54c88859b5a1b9a4b867b2ed984f881f506ccfe630da240738e924a561207927"}
Oct 30 21:58:38.502587 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.502559    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 21:58:38.505622 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.505588    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.505793 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.505668    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.505864 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.505805    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.505988 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.505969    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.506042 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.506018    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.506106 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.506060    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.506161 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.506110    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.506161 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.506138    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwf8h\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.506257 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.506186    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.512951 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:58:38.512909    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e765b0_07bd_4470_ac02_e3a57bdf6661.slice/crio-6634868618e2b55f881e1f1ab8644e35e116f60ec2fa58a46ed688a4cc0a191a WatchSource:0}: Error finding container 6634868618e2b55f881e1f1ab8644e35e116f60ec2fa58a46ed688a4cc0a191a: Status 404 returned error can't find the container with id 6634868618e2b55f881e1f1ab8644e35e116f60ec2fa58a46ed688a4cc0a191a
Oct 30 21:58:38.515426 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.515390    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:38.515535 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.515456    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:38.515535 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.515490    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:38.563895 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.562956    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 21:58:38.606872 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.606845    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607051 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.606916    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607051 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.606986    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607051 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607031    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607120    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607154    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607223 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607189    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607233    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607257    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwf8h\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607318    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607539 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607411    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607673 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607649    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607816 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607797    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.607989 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.607972    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.609690 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.609666    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.610009 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.609993    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.664273 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.664216    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.664487 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.664465    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwf8h\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.685898 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.683894    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podStartSLOduration=2.68387563 podStartE2EDuration="2.68387563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:38.68310942 +0000 UTC m=+923.652955831" watchObservedRunningTime="2026-10-30 21:58:38.68387563 +0000 UTC m=+923.653722039"
Oct 30 21:58:38.755089 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.754996    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 21:58:38.759102 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.759076    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.779546 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.779520    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:38.808229 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.808037    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-a07620-openshift-default-dockercfg-p8t9r\""
Oct 30 21:58:38.809488 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809464    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809568 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809494    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809609 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809579    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809646 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809608    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809696    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g46\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809748 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809729    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809787 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809748    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809787 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809780    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.809872 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.809850    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.819217 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.819141    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 21:58:38.910846 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.910815    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.910984 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.910890    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.910984 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.910915    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.910984 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.910966    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911007    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911069    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78g46\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911097    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911155 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911125    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911347 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911175    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911572 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911520    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911722 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911701    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911851 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911833    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.911913 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.911869    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.912178 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.912158    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.913689 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.913670    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.913835 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.913813    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.965372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.965336    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:38.965672 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:38.965652    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g46\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:39.021187 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.021104    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:39.030954 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.030062    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:39.030954 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.030124    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:39.074311 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.074280    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:39.195107 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.195064    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 21:58:39.275157 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.274102    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.275157 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.274205    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.275157 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.274255    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.487949 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.484850    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" event={"ID":"07e765b0-07bd-4470-ac02-e3a57bdf6661","Type":"ContainerStarted","Data":"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"}
Oct 30 21:58:39.487949 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.484922    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" event={"ID":"07e765b0-07bd-4470-ac02-e3a57bdf6661","Type":"ContainerStarted","Data":"6634868618e2b55f881e1f1ab8644e35e116f60ec2fa58a46ed688a4cc0a191a"}
Oct 30 21:58:39.487949 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.487459    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" event={"ID":"b83b1d40-32a5-462b-a805-5979e5b1d75f","Type":"ContainerStarted","Data":"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"}
Oct 30 21:58:39.487949 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.487493    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" event={"ID":"b83b1d40-32a5-462b-a805-5979e5b1d75f","Type":"ContainerStarted","Data":"12d85ec809befd8b787c7b65fdab5b87f8b631c0e69254c2b15e18f2b8b10746"}
Oct 30 21:58:39.493011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.492984    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 21:58:39.497538 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:58:39.497516    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0c3f1c_5e0e_4453_856e_615413854369.slice/crio-a5bf7812630ce877e161b7d790fba1d22a9f640b526b9b468ef681bc6b1375cc WatchSource:0}: Error finding container a5bf7812630ce877e161b7d790fba1d22a9f640b526b9b468ef681bc6b1375cc: Status 404 returned error can't find the container with id a5bf7812630ce877e161b7d790fba1d22a9f640b526b9b468ef681bc6b1375cc
Oct 30 21:58:39.499820 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.499792    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.499890 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.499851    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.499890 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.499878    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:58:39.598786 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.598738    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podStartSLOduration=2.598725638 podStartE2EDuration="2.598725638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:39.596802042 +0000 UTC m=+924.566648452" watchObservedRunningTime="2026-10-30 21:58:39.598725638 +0000 UTC m=+924.568572045"
Oct 30 21:58:39.713514 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.713454    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podStartSLOduration=1.713432716 podStartE2EDuration="1.713432716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:39.711121665 +0000 UTC m=+924.680968075" watchObservedRunningTime="2026-10-30 21:58:39.713432716 +0000 UTC m=+924.683279124"
Oct 30 21:58:39.790107 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:39.790025    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:40.007294 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.007260    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:40.008693 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.008665    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:40.008839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.008715    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:40.021248 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.021214    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:40.021426 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.021276    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:40.530956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.528174    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" event={"ID":"7d0c3f1c-5e0e-4453-856e-615413854369","Type":"ContainerStarted","Data":"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"}
Oct 30 21:58:40.530956 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.528239    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" event={"ID":"7d0c3f1c-5e0e-4453-856e-615413854369","Type":"ContainerStarted","Data":"a5bf7812630ce877e161b7d790fba1d22a9f640b526b9b468ef681bc6b1375cc"}
Oct 30 21:58:40.659963 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.650694    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podStartSLOduration=2.650671476 podStartE2EDuration="2.650671476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:40.647458173 +0000 UTC m=+925.617304584" watchObservedRunningTime="2026-10-30 21:58:40.650671476 +0000 UTC m=+925.620517884"
Oct 30 21:58:40.785015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.784200    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:40.785015 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:40.784268    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:41.025126 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.025089    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:41.025752 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.025703    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:41.026385 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.026363    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:41.026584 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.026563    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:41.078201 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.078085    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:41.083112 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.083056    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:41.083311 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.083119    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:41.846632 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.846591    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:41.846971 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:41.846916    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:42.008960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.008475    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:42.008960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.008555    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:42.026027 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.025980    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:42.026809 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.026674    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:42.076528 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.076488    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:42.076840 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.076792    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:42.780837 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.780365    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:42.780837 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:42.780434    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:43.008349 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.008310    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:43.008644 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.008611    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:43.028407 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.028366    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:43.028996 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.028962    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:43.075448 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.075364    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:43.076630 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.076597    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:43.183968 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:58:43.176064    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:58:43.782419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.782378    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:43.782715 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:43.782685    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:44.010487 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.010448    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:44.010889 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.010858    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:44.020884 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.020857    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:58:44.021092 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.021071    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Oct 30 21:58:44.075614 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.075512    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:44.076262 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.076216    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:44.788456 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.788412    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:44.788786 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:44.788737    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:45.007411 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.007370    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Oct 30 21:58:45.007736 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.007702    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Oct 30 21:58:45.075818 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.075730    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:45.076462 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.076427    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:45.310948 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.310902    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:45.311694 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.311670    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:45.312634 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.312606    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 21:58:45.788115 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.788079    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:58:45.788419 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:45.788387    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 30 21:58:46.074807 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:46.074707    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:58:46.074807 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:46.074780    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 21:58:46.198400 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:46.198366    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:46.199991 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:46.199964    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:46.200793 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:46.200767    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 21:58:47.007141 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.007107    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:47.008975 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.007558    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:47.009153 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.009052    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 21:58:47.347709 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.347223    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:47.348213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.348111    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:58:47.349451 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:58:47.349430    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 21:59:12.937018 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:59:12.936979    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:59:13.929648 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:13.929599    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 21:59:13.935307 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:13.935282    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.027676 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027632    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.028136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027686    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.028136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027788    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g46wp\" (UniqueName: \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.028136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027815    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.028136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027858    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.028136 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.027969    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.030593 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.030571    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a07620\"/\"openshift-service-ca.crt\""
Oct 30 21:59:14.030693 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.030643    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a07620\"/\"kube-root-ca.crt\""
Oct 30 21:59:14.030755 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.030718    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a07620\"/\"default-dockercfg-4gr9b\""
Oct 30 21:59:14.030887 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.030873    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a07620\"/\"distinct-w1-a07620-kserve-self-signed-certs\""
Oct 30 21:59:14.033541 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.033523    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 21:59:14.129119 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129084    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g46wp\" (UniqueName: \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.129317 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129130    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.129317 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129176    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.129317 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129191    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.129317 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129259    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.129517 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.129319    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.130378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.130206    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.130378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.130237    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.130378 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.130292    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.132093 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.132049    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.132541 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.132298    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.183031 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.182958    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g46wp\" (UniqueName: \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\") pod \"distinct-w1-a07620-kserve-565d9f4498-qrtqr\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.248213 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.248170    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:14.666854 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.666817    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 21:59:14.672206 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:59:14.672178    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b8fa0de_0861_4b87_96eb_5d2641752395.slice/crio-7de36b1b449bba9ced498a857436e4ab73609252816cf950bbf8cbc8645eca9b WatchSource:0}: Error finding container 7de36b1b449bba9ced498a857436e4ab73609252816cf950bbf8cbc8645eca9b: Status 404 returned error can't find the container with id 7de36b1b449bba9ced498a857436e4ab73609252816cf950bbf8cbc8645eca9b
Oct 30 21:59:14.674188 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.674170    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:59:14.813496 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:14.813462    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" event={"ID":"6b8fa0de-0861-4b87-96eb-5d2641752395","Type":"ContainerStarted","Data":"7de36b1b449bba9ced498a857436e4ab73609252816cf950bbf8cbc8645eca9b"}
Oct 30 21:59:16.826701 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:16.826660    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" event={"ID":"6b8fa0de-0861-4b87-96eb-5d2641752395","Type":"ContainerStarted","Data":"bd9e9bc363ec9a4674e894b2b896a27f05faa9b46f595ae2bd4052043628f814"}
Oct 30 21:59:16.937179 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:16.937122    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podStartSLOduration=2.419618646 podStartE2EDuration="3.937106852s" totalImagesPullingTime="1.517488206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:16.934497435 +0000 UTC m=+961.904343869" watchObservedRunningTime="2026-10-30 21:59:16.937106852 +0000 UTC m=+961.906953261"
Oct 30 21:59:17.248703 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:17.248662    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:24.248955 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:24.248899    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:24.262256 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:24.262224    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:24.885988 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:24.885959    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 21:59:25.767708 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.767671    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 21:59:25.771941 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.771904    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.867999 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.867957    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2d1f91\"/\"openshift-service-ca.crt\""
Oct 30 21:59:25.868182 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868036    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2d1f91\"/\"distinct-w0-2d1f91-kserve-self-signed-certs\""
Oct 30 21:59:25.868182 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868057    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2d1f91\"/\"kube-root-ca.crt\""
Oct 30 21:59:25.868182 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868135    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2d1f91\"/\"default-dockercfg-jv6g7\""
Oct 30 21:59:25.868570 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868543    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.868621 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868594    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.868673 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868657    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.868803 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868782    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.868897 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868882    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.869005 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.868988    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszw9\" (UniqueName: \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.870994 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.870967    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 21:59:25.970480 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970442    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.970704 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970531    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.970704 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970681    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszw9\" (UniqueName: \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.970841 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970786    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.970841 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970826    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.971102 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.970862    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.971167 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.971116    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.971211 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.971174    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.971300 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.971273    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.973363 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.973341    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:25.973467 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:25.973394    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:26.025779 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:26.025704    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszw9\" (UniqueName: \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\") pod \"distinct-w0-2d1f91-kserve-588466d966-lqgmf\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:26.083943 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:26.083890    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:26.482456 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:26.482422    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 21:59:26.487888 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:59:26.487861    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc45c9a2_f318_4783_bafc_0ddebb0c6d2b.slice/crio-f77d0d6d3b59b671b1b8ff3b9ab8784b8050f417d8cbcd72aff49d995fe8f1e1 WatchSource:0}: Error finding container f77d0d6d3b59b671b1b8ff3b9ab8784b8050f417d8cbcd72aff49d995fe8f1e1: Status 404 returned error can't find the container with id f77d0d6d3b59b671b1b8ff3b9ab8784b8050f417d8cbcd72aff49d995fe8f1e1
Oct 30 21:59:26.892710 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:26.892671    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" event={"ID":"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b","Type":"ContainerStarted","Data":"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"}
Oct 30 21:59:26.893110 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:26.892717    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" event={"ID":"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b","Type":"ContainerStarted","Data":"f77d0d6d3b59b671b1b8ff3b9ab8784b8050f417d8cbcd72aff49d995fe8f1e1"}
Oct 30 21:59:27.001944 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:27.001875    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podStartSLOduration=2.001862014 podStartE2EDuration="2.001862014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:26.999391231 +0000 UTC m=+971.969237640" watchObservedRunningTime="2026-10-30 21:59:27.001862014 +0000 UTC m=+971.971708423"
Oct 30 21:59:27.084372 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:27.084338    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:36.084395 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:36.084357    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:36.097125 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:36.097092    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:36.962162 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:36.962125    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 21:59:42.933859 ip-10-0-139-66 kubenswrapper[5579]: E1030 21:59:42.933817    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 21:59:54.337960 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.337899    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 21:59:54.345756 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.345727    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.448455 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.448422    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 21:59:54.451472 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451435    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451512    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451553    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451628 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451594    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451797 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451726    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhp68\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451810    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451853 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451845    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.451979 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.451887    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.452050 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.452010    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553214 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553173    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhp68\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553244    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553260    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553280    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553301    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553352    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553405 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553403    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553726 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553437    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553726 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553472    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553744    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553839 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553751    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553996 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553923    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.553996 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.553975    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.554248 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.554224    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.556268 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.556240    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.556460 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.556441    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.607707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.607613    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhp68\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.607707 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.607636    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:54.660406 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:54.660377    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:55.085415 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:55.085335    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 21:59:55.092256 ip-10-0-139-66 kubenswrapper[5579]: W1030 21:59:55.092219    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845c9a0b_5670_46a0_b2bc_2e8504615dbd.slice/crio-1adc2513c961a7e003a058288ea303c00adf7fbc56ceee0346e8ae3973a15461 WatchSource:0}: Error finding container 1adc2513c961a7e003a058288ea303c00adf7fbc56ceee0346e8ae3973a15461: Status 404 returned error can't find the container with id 1adc2513c961a7e003a058288ea303c00adf7fbc56ceee0346e8ae3973a15461
Oct 30 21:59:55.094909 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:55.094868    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:59:55.095018 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:55.095002    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:59:55.095059 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:55.095046    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:59:56.069998 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:56.069955    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" event={"ID":"845c9a0b-5670-46a0-b2bc-2e8504615dbd","Type":"ContainerStarted","Data":"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"}
Oct 30 21:59:56.070486 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:56.070011    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" event={"ID":"845c9a0b-5670-46a0-b2bc-2e8504615dbd","Type":"ContainerStarted","Data":"1adc2513c961a7e003a058288ea303c00adf7fbc56ceee0346e8ae3973a15461"}
Oct 30 21:59:56.661276 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:56.661240    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 21:59:56.663011 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:56.662985    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:59:56.663135 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:56.663048    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 21:59:57.661197 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:57.661159    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:59:57.661588 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:57.661214    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 21:59:58.661819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:58.661441    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:59:58.661819 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:58.661502    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 21:59:59.661219 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:59.661180    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:59:59.661408 ip-10-0-139-66 kubenswrapper[5579]: I1030 21:59:59.661236    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:00:00.661543 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:00.661507    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:00:00.661984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:00.661568    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:00:01.661784 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:01.661738    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:00:01.662339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:01.661796    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 30 22:00:02.665951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:02.665902    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 22:00:02.666380 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:02.666273    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 22:00:02.667090 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:02.667075    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 22:00:02.826750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:02.826698    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podStartSLOduration=8.826682529 podStartE2EDuration="8.826682529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:56.27882117 +0000 UTC m=+1001.248667578" watchObservedRunningTime="2026-10-30 22:00:02.826682529 +0000 UTC m=+1007.796528938"
Oct 30 22:00:09.130752 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.130713    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:00:09.134913 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.134893    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.237290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.237254    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:00:09.257563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257533    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257567    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257606    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257758    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257821    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhjq\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257856    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257886    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.257979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.257963    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.258203 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.258046    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.358981    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359057    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359108    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359129    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359164    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359203    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359248    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smhjq\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359280    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359310    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359823 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359765    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.359823 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359782    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.360046 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359818    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.360046 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.359892    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.360116 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.360054    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.361509 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.361488    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.361779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.361762    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.413172 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.413126    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.413357 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.413332    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhjq\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\") pod \"e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") " pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.450264 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.450235    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:09.876177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.876089    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:00:09.881712 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:00:09.881682    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370e75b3_1d66_4d22_86e0_25421b3fe79d.slice/crio-3cf0a42202e793df6d4500b94624e5f8d1ddaed3ab8885058391596bd572d1e2 WatchSource:0}: Error finding container 3cf0a42202e793df6d4500b94624e5f8d1ddaed3ab8885058391596bd572d1e2: Status 404 returned error can't find the container with id 3cf0a42202e793df6d4500b94624e5f8d1ddaed3ab8885058391596bd572d1e2
Oct 30 22:00:09.884187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.884154    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:00:09.884270 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.884225    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:00:09.884270 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:09.884252    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:00:10.191383 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.191346    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" event={"ID":"370e75b3-1d66-4d22-86e0-25421b3fe79d","Type":"ContainerStarted","Data":"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"}
Oct 30 22:00:10.191897 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.191400    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" event={"ID":"370e75b3-1d66-4d22-86e0-25421b3fe79d","Type":"ContainerStarted","Data":"3cf0a42202e793df6d4500b94624e5f8d1ddaed3ab8885058391596bd572d1e2"}
Oct 30 22:00:10.301858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.301802    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podStartSLOduration=1.301787998 podStartE2EDuration="1.301787998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:10.301350139 +0000 UTC m=+1015.271196549" watchObservedRunningTime="2026-10-30 22:00:10.301787998 +0000 UTC m=+1015.271634407"
Oct 30 22:00:10.453094 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.452993    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:10.456950 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.454235    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:10.456950 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:10.454294    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:11.451470 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:11.451429    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:11.451885 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:11.451523    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:12.451792 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:12.451755    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:12.452237 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:12.451837    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:12.960259 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:00:12.960218    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:00:13.447851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.447803    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:00:13.451362 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.451309    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:13.451566 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.451384    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:13.452625 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.452601    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.519987    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.520135    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.520192    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2vh8\" (UniqueName: \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.520240    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.520307    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.520439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.520334    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.554689 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.554656    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:00:13.555117 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.555093    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5be0d1\"/\"default-dockercfg-mkbfj\""
Oct 30 22:00:13.555777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.555262    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5be0d1\"/\"openshift-service-ca.crt\""
Oct 30 22:00:13.555777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.555356    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5be0d1\"/\"kube-root-ca.crt\""
Oct 30 22:00:13.555777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.555178    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5be0d1\"/\"distinct-2-w2-5be0d1-kserve-self-signed-certs\""
Oct 30 22:00:13.621516 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621482    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.621716 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621548    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2vh8\" (UniqueName: \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.621716 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621592    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.621716 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621653    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.621716 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621680    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.621921 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621763    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.622012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.621914    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.643952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.622060    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.643952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.622090    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.661280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.661244    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.672022 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.671953    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.675903 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.675829    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2vh8\" (UniqueName: \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\") pod \"distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") " pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:13.767476 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:13.767366    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:14.215966 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:14.215916    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:00:14.219581 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:00:14.219553    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6057361_a85b_4e03_8a06_da6ed1349f24.slice/crio-6169798a3f28965753b0bf16fb3fad75caa76e13c0a052ee4cd5c8ecb770d653 WatchSource:0}: Error finding container 6169798a3f28965753b0bf16fb3fad75caa76e13c0a052ee4cd5c8ecb770d653: Status 404 returned error can't find the container with id 6169798a3f28965753b0bf16fb3fad75caa76e13c0a052ee4cd5c8ecb770d653
Oct 30 22:00:14.451182 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:14.451144    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:14.451364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:14.451214    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:15.255176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.255135    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" event={"ID":"a6057361-a85b-4e03-8a06-da6ed1349f24","Type":"ContainerStarted","Data":"0785aef088fc818bbf6c0d2ce9541612d25a862a2cd8acb60e821ad536183bc1"}
Oct 30 22:00:15.255725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.255700    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" event={"ID":"a6057361-a85b-4e03-8a06-da6ed1349f24","Type":"ContainerStarted","Data":"6169798a3f28965753b0bf16fb3fad75caa76e13c0a052ee4cd5c8ecb770d653"}
Oct 30 22:00:15.366177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.366127    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podStartSLOduration=2.366112956 podStartE2EDuration="2.366112956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:15.363779622 +0000 UTC m=+1020.333626031" watchObservedRunningTime="2026-10-30 22:00:15.366112956 +0000 UTC m=+1020.335959365"
Oct 30 22:00:15.451416 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.451377    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:15.451599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.451447    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:15.768485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:15.768440    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:16.450811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:16.450768    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:00:16.451392 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:16.450820    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 30 22:00:17.455739 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:17.455703    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:17.456165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:17.456030    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:17.456913 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:17.456886    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:00:23.768129 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:23.768094    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:23.780631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:23.780597    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:24.324810 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:00:24.324781    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:00:42.930995 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:00:42.930923    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:01:10.078595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.078552    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:01:10.082920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.082897    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.179641 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.179608    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a07620\"/\"distinct-2-w1-a07620-kserve-self-signed-certs\""
Oct 30 22:01:10.183100 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.183072    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:01:10.242375 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242339    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.242567 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242405    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.242567 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242506    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsg6r\" (UniqueName: \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.242642 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242610    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.242680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242661    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.242742 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.242728    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.344657 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.344567    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.344657 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.344640    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.344892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.344802    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.344892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.344859    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.345061 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.344957    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.345061 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.345014    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsg6r\" (UniqueName: \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.345380 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.345346    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.345587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.345565    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.345845 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.345822    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.347156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.347133    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.347593 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.347574    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.399032 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.398999    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsg6r\" (UniqueName: \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\") pod \"distinct-2-w1-a07620-kserve-8658cb55c7-km9rr\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") " pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:10.695273 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:10.695237    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:11.070159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:11.070064    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:01:11.075658 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:01:11.075625    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab9268e2_6e2e_4ed6_9730_43e136c37e4b.slice/crio-35f3dca69d77085cbedc347636a56ef3963942a103152687f10d51c14a9dd620 WatchSource:0}: Error finding container 35f3dca69d77085cbedc347636a56ef3963942a103152687f10d51c14a9dd620: Status 404 returned error can't find the container with id 35f3dca69d77085cbedc347636a56ef3963942a103152687f10d51c14a9dd620
Oct 30 22:01:11.614013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:11.613964    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" event={"ID":"ab9268e2-6e2e-4ed6-9730-43e136c37e4b","Type":"ContainerStarted","Data":"a0d0706e785417e6c54cfbfcfe7a559bdb462797fe40cff525f8736f04aa4d71"}
Oct 30 22:01:11.614425 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:11.614025    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" event={"ID":"ab9268e2-6e2e-4ed6-9730-43e136c37e4b","Type":"ContainerStarted","Data":"35f3dca69d77085cbedc347636a56ef3963942a103152687f10d51c14a9dd620"}
Oct 30 22:01:11.696346 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:11.696293    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:11.723094 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:11.723040    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podStartSLOduration=1.7230244369999999 podStartE2EDuration="1.723024437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:11.72116885 +0000 UTC m=+1076.691015258" watchObservedRunningTime="2026-10-30 22:01:11.723024437 +0000 UTC m=+1076.692870859"
Oct 30 22:01:12.929811 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:01:12.929769    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:01:20.696213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:20.696170    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:20.709200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:20.709172    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:21.685199 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:21.685165    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:01:23.256975 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.256920    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:01:23.263021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.262990    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295139    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295335 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295197    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295335 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295302    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295409 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295359    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnh4m\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295409 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295392    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295518    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295572 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295557    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295606    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.295753 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.295671    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.396975    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397044    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397116    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397151    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397204    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397252    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397310    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397343    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnh4m\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397394    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397570    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397573    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.397768    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.398217    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.398954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.398231    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.400198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.400138    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.400727 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.400697    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.453982 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.453403    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnh4m\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.453982 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.453916    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:23.492924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.492821    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:01:23.586338 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:23.586249    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:24.017762 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.017729    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:01:24.020672 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:01:24.020644    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3090a44_d40c_433e_8c2a_2a0c99f1adfc.slice/crio-33c22ef33b83fa99a063f4fa67e314d4fd0608ba0fa74459d292e07a8a128ccf WatchSource:0}: Error finding container 33c22ef33b83fa99a063f4fa67e314d4fd0608ba0fa74459d292e07a8a128ccf: Status 404 returned error can't find the container with id 33c22ef33b83fa99a063f4fa67e314d4fd0608ba0fa74459d292e07a8a128ccf
Oct 30 22:01:24.023302 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.023266    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:01:24.023399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.023361    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:01:24.023399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.023392    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:01:24.709806 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.709765    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" event={"ID":"a3090a44-d40c-433e-8c2a-2a0c99f1adfc","Type":"ContainerStarted","Data":"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"}
Oct 30 22:01:24.710215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.709826    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" event={"ID":"a3090a44-d40c-433e-8c2a-2a0c99f1adfc","Type":"ContainerStarted","Data":"33c22ef33b83fa99a063f4fa67e314d4fd0608ba0fa74459d292e07a8a128ccf"}
Oct 30 22:01:24.913881 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:24.913825    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podStartSLOduration=1.913811283 podStartE2EDuration="1.913811283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:24.865391063 +0000 UTC m=+1089.835237475" watchObservedRunningTime="2026-10-30 22:01:24.913811283 +0000 UTC m=+1089.883657691"
Oct 30 22:01:25.587516 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:25.587476    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:25.589254 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:25.589227    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:25.589382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:25.589275    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:26.587635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:26.587601    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:26.588059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:26.587661    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:27.587457 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:27.587423    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:27.587631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:27.587488    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:28.586779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:28.586737    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:28.587235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:28.586798    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:29.586945 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:29.586897    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:29.587366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:29.587001    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:30.587028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:30.586988    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 22:01:30.587435 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:30.587059    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 22:01:31.591703 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:31.591667    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:31.592159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:31.591960    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:31.592622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:31.592605    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:01:42.930362 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:01:42.930325    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:01:46.119157 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.119120    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:01:46.123243 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.123219    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208239    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhv2\" (UniqueName: \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208463 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208289    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208463 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208421    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208466    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208499    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.208691 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.208626    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.218469 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.218435    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2d1f91\"/\"distinct-2-w0-2d1f91-kserve-self-signed-certs\""
Oct 30 22:01:46.223079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.223045    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:01:46.309776 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.309735    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.309987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.309829    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.309987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.309868    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.309987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.309908    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.310181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.310033    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhv2\" (UniqueName: \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.310181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.310066    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.310296 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.310262    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.310345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.310309    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.310654 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.310630    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.313048 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.313024    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.313293 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.313272    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.364052 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.364015    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhv2\" (UniqueName: \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\") pod \"distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") " pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.438624 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.438582    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:46.835131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.835036    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:01:46.839986 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:01:46.839950    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod887e1fb1_5161_4ab2_a26c_0ec95b3dd229.slice/crio-99798d4925663bda8f6bcbc5d424612cf59f5a854762111ffb9565ba653f7ab7 WatchSource:0}: Error finding container 99798d4925663bda8f6bcbc5d424612cf59f5a854762111ffb9565ba653f7ab7: Status 404 returned error can't find the container with id 99798d4925663bda8f6bcbc5d424612cf59f5a854762111ffb9565ba653f7ab7
Oct 30 22:01:46.870102 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:46.870070    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" event={"ID":"887e1fb1-5161-4ab2-a26c-0ec95b3dd229","Type":"ContainerStarted","Data":"99798d4925663bda8f6bcbc5d424612cf59f5a854762111ffb9565ba653f7ab7"}
Oct 30 22:01:47.878305 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:47.878267    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" event={"ID":"887e1fb1-5161-4ab2-a26c-0ec95b3dd229","Type":"ContainerStarted","Data":"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"}
Oct 30 22:01:47.990959 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:47.990868    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podStartSLOduration=1.990852126 podStartE2EDuration="1.990852126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:47.989838033 +0000 UTC m=+1112.959684463" watchObservedRunningTime="2026-10-30 22:01:47.990852126 +0000 UTC m=+1112.960698534"
Oct 30 22:01:48.438869 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:48.438834    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:56.439570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:56.439528    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:56.452256 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:56.452227    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:01:56.947162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:01:56.947134    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:02:12.930573 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:02:12.930535    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:02:17.293430 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:17.293047    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:02:17.293430 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:17.293124    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:02:38.464783 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.464753    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:02:38.469379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.469344    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550147 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550110    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550348 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550154    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550348 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550291    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550348 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550344    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550515 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550371    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4v8\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550515 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550473    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550754 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550726    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.550897 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550772    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.551003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.550953    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652152    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652195    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652214    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652268    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652307    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652335    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4v8\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652383    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652473    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652556    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652791 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652766    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.652862 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.652793    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.653041 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.653015    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.653177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.653073    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.653177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.653124    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.654648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.654625    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.654808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.654786    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.716269 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.716012    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:02:38.716494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.716469    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.716617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.716557    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4v8\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:38.802253 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:38.802213    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:39.253200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.253157    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:02:39.258008 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:02:39.257974    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6052ef14_3607_43d5_977a_5689d42faebe.slice/crio-b525c1e45452c1e1e160b889aa27ceaf52f8af3446de3a76bb176a904a7503a0 WatchSource:0}: Error finding container b525c1e45452c1e1e160b889aa27ceaf52f8af3446de3a76bb176a904a7503a0: Status 404 returned error can't find the container with id b525c1e45452c1e1e160b889aa27ceaf52f8af3446de3a76bb176a904a7503a0
Oct 30 22:02:39.260486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.260454    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:39.260595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.260528    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:39.260595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.260574    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:39.276363 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.276330    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" event={"ID":"6052ef14-3607-43d5-977a-5689d42faebe","Type":"ContainerStarted","Data":"b525c1e45452c1e1e160b889aa27ceaf52f8af3446de3a76bb176a904a7503a0"}
Oct 30 22:02:39.502956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.502897    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:02:39.507056 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.506995    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.566974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.566913    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mkd\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567175 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567025    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567175 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567079    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567175 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567143    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567196    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567307    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567351    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567826 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567390    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.567826 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.567440    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.607545 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.607513    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669056    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669135    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669177    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669275    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669301    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669337    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669375    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669497    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mkd\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.669569    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.670503    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.671190    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.671445    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.674000    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.674679    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.675575    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.684954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.676861    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.730991 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.730956    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.731436 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.731405    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mkd\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\") pod \"e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") " pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.794743 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.794653    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:02:39.800129 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.800101    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.821825 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.821800    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:39.850523 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.850496    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-5be0d1-openshift-default-dockercfg-f2nmw\""
Oct 30 22:02:39.870096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.862529    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:02:39.872677 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872633    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.872835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872705    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.872835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872743    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.872835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872766    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.872835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872813    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.873120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.872914    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ptq6\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.873120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.873027    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.873120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.873061    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.873640 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.873614    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.977982    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978033    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978127    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978171    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978213    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978250    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978273    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978322    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.978426    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ptq6\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.979591    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.979942    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.980576    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.980786    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.981016    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.991952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.991736    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:39.997127 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:39.997103    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:40.062112 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.045154    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ptq6\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:40.063159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.063129    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:40.115423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.115388    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:40.252947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.252883    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:02:40.259545 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:02:40.259518    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4ab295_37f3_4f83_a94a_d29fb75f9e77.slice/crio-8e2154b8c1738c68add0113ca8a3377a3e003e310a885a77813b8cc8857e2545 WatchSource:0}: Error finding container 8e2154b8c1738c68add0113ca8a3377a3e003e310a885a77813b8cc8857e2545: Status 404 returned error can't find the container with id 8e2154b8c1738c68add0113ca8a3377a3e003e310a885a77813b8cc8857e2545
Oct 30 22:02:40.270639 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.270595    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.270757 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.270687    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.270757 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.270728    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.286979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.286914    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" event={"ID":"6052ef14-3607-43d5-977a-5689d42faebe","Type":"ContainerStarted","Data":"1eb86a61406c90b634f5ef418c1aa288f1d2d5824a1eeea203a248fc424c65b0"}
Oct 30 22:02:40.288900 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.288871    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" event={"ID":"1f4ab295-37f3-4f83-a94a-d29fb75f9e77","Type":"ContainerStarted","Data":"8e2154b8c1738c68add0113ca8a3377a3e003e310a885a77813b8cc8857e2545"}
Oct 30 22:02:40.420546 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.420493    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podStartSLOduration=2.420479104 podStartE2EDuration="2.420479104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:40.419273251 +0000 UTC m=+1165.389119857" watchObservedRunningTime="2026-10-30 22:02:40.420479104 +0000 UTC m=+1165.390325512"
Oct 30 22:02:40.554028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.553963    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:02:40.563272 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:02:40.563235    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6beb42_f658_4f07_ad24_85753d695b0a.slice/crio-352952c2e869d13948963d519934803f7d537dff63b1e311f65d12945cd0b890 WatchSource:0}: Error finding container 352952c2e869d13948963d519934803f7d537dff63b1e311f65d12945cd0b890: Status 404 returned error can't find the container with id 352952c2e869d13948963d519934803f7d537dff63b1e311f65d12945cd0b890
Oct 30 22:02:40.565671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.565636    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.565765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.565718    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.565765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.565749    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:02:40.803028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.802988    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:40.804527 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.804500    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:40.804664 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:40.804561    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:41.304842 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.303551    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" event={"ID":"7d6beb42-f658-4f07-ad24-85753d695b0a","Type":"ContainerStarted","Data":"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"}
Oct 30 22:02:41.304842 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.303620    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" event={"ID":"7d6beb42-f658-4f07-ad24-85753d695b0a","Type":"ContainerStarted","Data":"352952c2e869d13948963d519934803f7d537dff63b1e311f65d12945cd0b890"}
Oct 30 22:02:41.309898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.309857    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" event={"ID":"1f4ab295-37f3-4f83-a94a-d29fb75f9e77","Type":"ContainerStarted","Data":"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"}
Oct 30 22:02:41.443951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.442742    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podStartSLOduration=2.4427209149999998 podStartE2EDuration="2.442720915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:41.419817619 +0000 UTC m=+1166.389664028" watchObservedRunningTime="2026-10-30 22:02:41.442720915 +0000 UTC m=+1166.412567325"
Oct 30 22:02:41.803453 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.803411    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:41.803901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.803475    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:41.827754 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.827715    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:41.828188 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.828048    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:41.828188 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:41.828111    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:42.116230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.116142    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:42.117648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.117625    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:42.117704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.117685    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:42.803543 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.803509    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:42.804038 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.804010    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:42.826391 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.826354    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:42.826664 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:42.826629    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:42.999954 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:02:42.998195    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:02:43.116539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.116461    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:43.116539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.116513    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:43.803508 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.803464    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:43.803734 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.803525    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:43.832963 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.830363    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:43.832963 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:43.830428    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:44.116322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.116223    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:44.116322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.116282    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:44.803651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.803606    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:44.803846 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.803704    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:44.829956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.826493    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:44.829956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:44.826577    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:45.115849 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.115762    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:45.115849 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.115821    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:45.803728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.803686    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:02:45.803910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.803742    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 30 22:02:45.834954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.833061    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:45.834954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:45.833123    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:46.116532 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:46.116443    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:46.116532 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:46.116514    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:46.826954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:46.826333    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:02:46.826954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:46.826398    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 22:02:47.116159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.116058    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:02:47.116159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.116127    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 30 22:02:47.138256 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.138226    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:47.139542 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.139512    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:47.150120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.150094    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:02:47.279944 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:47.279864    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podStartSLOduration=8.279844366 podStartE2EDuration="8.279844366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:41.547281461 +0000 UTC m=+1166.517127871" watchObservedRunningTime="2026-10-30 22:02:47.279844366 +0000 UTC m=+1172.249690777"
Oct 30 22:02:48.050352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.048555    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:48.050352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.050166    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:48.050985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.050962    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:02:48.378116 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.378027    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:48.378820 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.378793    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:02:48.380036 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:02:48.380019    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:03:12.931287 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:03:12.931187    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:03:34.325102 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:34.325036    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:03:39.262570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.262532    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:03:39.269357 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.269309    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.372593 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.372554    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:03:39.411265 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.411208    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.411635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.411607    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.411874 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.411854    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412093    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412126    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412195    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbfkv\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412275    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412345    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.412524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.412505    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.513789 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.513694    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.513831    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.513910    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.513993    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514209 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514045    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514209 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514127    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514209 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514153    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514209 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514190    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbfkv\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514200    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514234    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514251    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514621 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514471    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.514621 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514590    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.515016 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.514992    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.516401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.516380    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.516695 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.516674    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.568202 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.568170    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.568354 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.568288    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbfkv\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\") pod \"e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") " pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:39.583986 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:39.583960    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:40.024590 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.024550    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:03:40.029275 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:03:40.029246    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086eb7c9_fe65_40f2_8aa1_b9bf829b575b.slice/crio-49b0634d20a3c1f1c40c1963a68675a4538afcfa47c2ac3902a2ac5b5d8638a9 WatchSource:0}: Error finding container 49b0634d20a3c1f1c40c1963a68675a4538afcfa47c2ac3902a2ac5b5d8638a9: Status 404 returned error can't find the container with id 49b0634d20a3c1f1c40c1963a68675a4538afcfa47c2ac3902a2ac5b5d8638a9
Oct 30 22:03:40.031888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.031851    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:40.032002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.031923    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:40.032002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.031967    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:40.279403 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.279299    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:03:40.284613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.284584    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.345451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.345414    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:03:40.431586 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.431551    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.431796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.431596    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.431868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.431832    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.431968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.431871    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4nw\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.431968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.431913    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.432085 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.432018    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.432146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.432098    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.432146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.432123    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.432266 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.432250    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533184 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533098    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533184 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533142    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4nw\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533184 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533177    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533206    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533281    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533302    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533384    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533454    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533482    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533519    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533684    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.533869 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.533780    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.534107 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.534084    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.534201 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.534133    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.535608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.535580    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.535890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.535870    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.588499 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.588472    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4nw\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.588659 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.588517    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.602670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.602639    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:40.876339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.876261    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" event={"ID":"086eb7c9-fe65-40f2-8aa1-b9bf829b575b","Type":"ContainerStarted","Data":"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"}
Oct 30 22:03:40.876339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:40.876329    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" event={"ID":"086eb7c9-fe65-40f2-8aa1-b9bf829b575b","Type":"ContainerStarted","Data":"49b0634d20a3c1f1c40c1963a68675a4538afcfa47c2ac3902a2ac5b5d8638a9"}
Oct 30 22:03:41.010924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.010870    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podStartSLOduration=2.010857552 podStartE2EDuration="2.010857552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:41.008798381 +0000 UTC m=+1225.978644834" watchObservedRunningTime="2026-10-30 22:03:41.010857552 +0000 UTC m=+1225.980703960"
Oct 30 22:03:41.059024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.059001    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:03:41.063827 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.063793    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:41.063976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.063879    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:41.063976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.063943    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:41.584822 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.584724    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:41.586748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.586719    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:41.586864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.586770    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:41.892216 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.892175    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" event={"ID":"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7","Type":"ContainerStarted","Data":"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"}
Oct 30 22:03:41.892418 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:41.892235    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" event={"ID":"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7","Type":"ContainerStarted","Data":"a343a273b7fedbd6eee205d2cdeac0ed4c302477fe0f2cd972b02d66ad730d99"}
Oct 30 22:03:42.007196 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.007131    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podStartSLOduration=2.007113029 podStartE2EDuration="2.007113029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:42.006643078 +0000 UTC m=+1226.976489487" watchObservedRunningTime="2026-10-30 22:03:42.007113029 +0000 UTC m=+1226.976959440"
Oct 30 22:03:42.585221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.585182    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:42.585636 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.585237    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:42.604046 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.604010    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:42.605160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.605139    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:42.605213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:42.605193    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:42.987343 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:03:42.987300    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:03:43.585338 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:43.585287    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:43.585831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:43.585362    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:43.602991 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:43.602954    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:43.603155 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:43.603031    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:44.584368 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:44.584337    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:44.584681 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:44.584658    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:44.603880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:44.603842    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:44.604298 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:44.604186    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:45.584445 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:45.584406    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:45.584631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:45.584471    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:45.603050 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:45.603017    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:45.603218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:45.603071    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:46.584904 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:46.584862    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:03:46.585384 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:46.584951    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Oct 30 22:03:46.603968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:46.603898    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:46.604139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:46.603978    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:47.603634 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:47.603594    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:03:47.604204 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:47.603669    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 30 22:03:48.006953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.005888    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:48.006953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.006787    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:48.007588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.007560    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:03:48.770961 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.770895    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:48.772107 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.772087    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:48.772711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:48.772695    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:03:54.695947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.695905    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:03:54.700452 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.700430    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.742197 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.742159    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:03:54.746415 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.746395    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.788274 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.788229    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:03:54.793713 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.793680    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.793881 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.793836    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.793968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.793947    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.793987    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.794002    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794110 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.794020    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxnc\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.794160    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794277 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.794264    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.794314 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.794297    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.888252 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.888203    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:03:54.895910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.895881    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.895922    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.895984    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896002    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896017    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxnc\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896044    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896062    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896101    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896143    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896173    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896200    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896215    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896240    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896264    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896299    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tnbb\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896338    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896393    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.896502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896414    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.897043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.896810    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.897043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.897029    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.898817 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.898696    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.899132 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.899112    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.899999 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.899959    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.900096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.900059    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.900153 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.900087    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.950797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.950717    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.951457 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.951437    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxnc\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:54.997873 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.997834    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.997899    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998038    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998092    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998319 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998136    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998319 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998168    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998319 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998203    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tnbb\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998328    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998406    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998420    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998443    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998778 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998758    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998904 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998867    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:54.998985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:54.998961    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.000254 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.000233    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.000822 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.000788    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.014868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.014832    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:55.056001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.055963    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.056001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.056013    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tnbb\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\") pod \"e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") " pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.060127 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.059892    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:55.389409 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.389349    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:03:55.394648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.394629    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.444223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.444196    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:03:55.448133 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:03:55.448107    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2810689e_c0e1_479f_96ad_d014310d709a.slice/crio-b8f00558c7b9eab2bacbafa53214b0be4e747ee464c440a33136cdbbda4b244c WatchSource:0}: Error finding container b8f00558c7b9eab2bacbafa53214b0be4e747ee464c440a33136cdbbda4b244c: Status 404 returned error can't find the container with id b8f00558c7b9eab2bacbafa53214b0be4e747ee464c440a33136cdbbda4b244c
Oct 30 22:03:55.450612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.450582    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.450697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.450645    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.450697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.450672    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.456052 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.455873    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:03:55.501916 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.501861    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:03:55.505136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505103    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505154    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg97p\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505280    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505389 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505374    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505539    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505584    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505753    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505786    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.505851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.505817    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.514574 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:03:55.513347    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9437bc08_136f_40fb_84b2_25348c2b05cc.slice/crio-43d910d854a17b808972fdf68609cee8d2adc1d5fed530df282be212148e0373 WatchSource:0}: Error finding container 43d910d854a17b808972fdf68609cee8d2adc1d5fed530df282be212148e0373: Status 404 returned error can't find the container with id 43d910d854a17b808972fdf68609cee8d2adc1d5fed530df282be212148e0373
Oct 30 22:03:55.517306 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.517275    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.517426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.517355    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.517426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.517382    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:55.607395 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607366    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607572 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607463    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607572 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607485    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607572 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607543    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607572 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607562    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607576    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607616    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607637    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg97p\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607674    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.607815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.607801    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.608122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.608075    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.608303 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.608284    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.608958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.608781    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.608958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.608951    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.612344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.611103    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.612344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.611534    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.664514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.664435    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.669757 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.669730    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg97p\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\") pod \"e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") " pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:55.709632 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:55.709603    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:56.000656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.000510    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" event={"ID":"9437bc08-136f-40fb-84b2-25348c2b05cc","Type":"ContainerStarted","Data":"76ea40e5bd3e0bcd2c90b8257b7359461158fd9b0638234531e54159f466355d"}
Oct 30 22:03:56.000656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.000640    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" event={"ID":"9437bc08-136f-40fb-84b2-25348c2b05cc","Type":"ContainerStarted","Data":"43d910d854a17b808972fdf68609cee8d2adc1d5fed530df282be212148e0373"}
Oct 30 22:03:56.002687 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.002655    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" event={"ID":"2810689e-c0e1-479f-96ad-d014310d709a","Type":"ContainerStarted","Data":"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"}
Oct 30 22:03:56.002866 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.002709    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" event={"ID":"2810689e-c0e1-479f-96ad-d014310d709a","Type":"ContainerStarted","Data":"b8f00558c7b9eab2bacbafa53214b0be4e747ee464c440a33136cdbbda4b244c"}
Oct 30 22:03:56.015482 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.015448    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:03:56.017067 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.017039    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:03:56.017229 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.017091    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:03:56.066953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.064327    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:03:56.076957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.068066    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:03:56.076957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.068129    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:03:56.105033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.104992    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:03:56.107447 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:03:56.107418    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fd0ab4_0670_43c2_854b_8d719b086aec.slice/crio-bcbba7bd4dd7158ec5cddee8e1a94cc3b73706b2a62f452abd2a7a80b3c91947 WatchSource:0}: Error finding container bcbba7bd4dd7158ec5cddee8e1a94cc3b73706b2a62f452abd2a7a80b3c91947: Status 404 returned error can't find the container with id bcbba7bd4dd7158ec5cddee8e1a94cc3b73706b2a62f452abd2a7a80b3c91947
Oct 30 22:03:56.117152 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.117118    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:56.117334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.117316    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:56.117439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.117426    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:56.121076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.121054    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:03:56.141954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.134058    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podStartSLOduration=2.13401946 podStartE2EDuration="2.13401946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:56.118068915 +0000 UTC m=+1241.087915318" watchObservedRunningTime="2026-10-30 22:03:56.13401946 +0000 UTC m=+1241.103865870"
Oct 30 22:03:56.188973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.179277    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.205624 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.205586    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:03:56.289843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.289779    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podStartSLOduration=2.289759545 podStartE2EDuration="2.289759545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:56.289155166 +0000 UTC m=+1241.259001580" watchObservedRunningTime="2026-10-30 22:03:56.289759545 +0000 UTC m=+1241.259605955"
Oct 30 22:03:56.318435 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318404    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318531    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318567    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318590    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8tmr\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318733 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318646    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318770 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318742    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318770 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318761    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318845 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318816    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.318882 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.318844    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.419899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.419855    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420144    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420286 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420263    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420417 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420269    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8tmr\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420523 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420512    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420661 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420649    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420737 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420728    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.420851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.420842    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421004    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421272    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421281    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421085    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421396    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.421534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.421508    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.445507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.439286    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.476952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.473903    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.488631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.488553    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8tmr\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.490008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.489972    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\") pod \"e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") " pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:56.551005 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:56.550309    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:57.007851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.007814    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:03:57.018423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.018393    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" event={"ID":"72fd0ab4-0670-43c2-854b-8d719b086aec","Type":"ContainerStarted","Data":"9a6170098944782b2bcec461535c6f4aecf97558f9a57d1c37e174d7daf90152"}
Oct 30 22:03:57.018518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.018442    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" event={"ID":"72fd0ab4-0670-43c2-854b-8d719b086aec","Type":"ContainerStarted","Data":"bcbba7bd4dd7158ec5cddee8e1a94cc3b73706b2a62f452abd2a7a80b3c91947"}
Oct 30 22:03:57.019361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.019336    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:03:57.019569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.019537    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:03:57.066141 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.065614    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:03:57.066141 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.065662    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:03:57.085003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.066711    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:57.085003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.066797    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:57.085003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.066841    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:03:57.169962 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.168539    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podStartSLOduration=2.168517846 podStartE2EDuration="2.168517846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:57.1489205 +0000 UTC m=+1242.118766913" watchObservedRunningTime="2026-10-30 22:03:57.168517846 +0000 UTC m=+1242.138364256"
Oct 30 22:03:57.712239 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.712212    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:03:57.715012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.714980    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:03:57.716072 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:57.716040    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:03:58.015858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.015758    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:03:58.016377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.016338    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:03:58.089965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.086095    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:03:58.089965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.086164    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:03:58.120069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.115878    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" event={"ID":"a7151163-353a-462d-90a3-e1e90affb2a7","Type":"ContainerStarted","Data":"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"}
Oct 30 22:03:58.120069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.115963    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" event={"ID":"a7151163-353a-462d-90a3-e1e90affb2a7","Type":"ContainerStarted","Data":"323f10f1898151f9fbe512ad16b6ac0a71af6342a06fb67d012d77176cc61351"}
Oct 30 22:03:58.560957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.560153    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:03:58.601962 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.586089    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:03:58.601962 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.586204    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:03:58.710673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.710636    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:03:58.710944 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.710896    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:03:58.980087 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:58.980047    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:03:59.021915 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.021886    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:03:59.022511 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.022479    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:03:59.109069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.109032    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:03:59.118114 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.118065    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:03:59.586447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.586399    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:03:59.586725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.586674    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:03:59.710424 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.710368    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:03:59.894894 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.870072    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:03:59.894894 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.870163    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:03:59.947958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.941131    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:00.012968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.986488    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:00.012968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:03:59.987103    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:00.653114 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.653072    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.129268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.129158    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:01.129516 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.985696    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:01.150158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.885586    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:01.150158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.655208    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.150158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.145432    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:04:01.150158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.024732    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Oct 30 22:04:01.150669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.024699    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:01.152279 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:04:01.106821    5579 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.966s"
Oct 30 22:04:01.164180 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.655275    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.164180 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.162076    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:04:01.164180 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:00.865978    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.164180 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.162447    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:04:01.245444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.205530    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.245444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.205587    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:04:01.247993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.247957    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.248224 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.248196    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:04:01.473955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.462525    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:01.613501 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.613454    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.613810 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.613769    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:01.748009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.726466    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:04:01.748009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.726544    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:04:01.854952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.853057    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:01.879081 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.858317    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:01.881123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.867684    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:01.916024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:01.915827    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:02.108024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.089327    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:02.121971 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.120058    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:04:02.122285 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.122237    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:04:02.126064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.121580    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:04:02.126315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.126287    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:04:02.194952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.166570    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:02.263956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.181115    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Oct 30 22:04:02.263956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.181526    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podStartSLOduration=6.181495919 podStartE2EDuration="6.181495919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:58.277313733 +0000 UTC m=+1243.247160157" watchObservedRunningTime="2026-10-30 22:04:02.181495919 +0000 UTC m=+1247.151342330"
Oct 30 22:04:02.263956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.181622    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:02.263956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.181646    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:02.521973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.512809    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:02.580063 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.580031    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:02.620194 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.620157    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:02.620455 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.620425    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:02.733163 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.733104    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:04:02.752002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.751718    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:04:02.812961 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.812861    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:02.821333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.820668    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:02.917702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.917655    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:02.918085 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:02.918050    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:03.015882 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.015851    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:03.038053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.038004    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:04:03.038334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.038299    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 30 22:04:03.245750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.240735    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:04:03.245750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.240787    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:04:03.609176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.594466    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:03.609176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.594540    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:03.716160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.715029    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:04:03.716160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:03.715092    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:04:04.082076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.082032    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:04:04.082622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.082094    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 22:04:04.619004 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.617048    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:04.619004 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.617113    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:04.713797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.713750    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:04:04.714089 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.714056    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 22:04:04.748444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.748400    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:04:04.750483 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.750458    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:04:04.759342 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:04.759306    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:04:05.231463 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.227593    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:04:05.234587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.234549    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:04:05.236489 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.236456    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:04:05.554511 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.554103    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:04:05.554511 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.554167    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 22:04:05.878641 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.878551    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:04:05.881839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.881785    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:04:05.894967 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:05.886396    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:04:06.938888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:06.938706    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:04:06.940171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:06.940142    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:04:06.941837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:06.941808    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:04:12.634875 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:12.634167    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:12.829310 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:12.828053    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:12.919285 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:12.919167    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.090954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.084374    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:13.286349 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.284071    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.658580 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:04:13.649608    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:04:13.658580 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.653214    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.684723 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.683572    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:13.845525 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.845422    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.846012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.845991    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:13.922482 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.922375    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:13.923149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:13.923125    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:14.095355 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.086240    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:14.095355 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.086956    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:14.337655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.324184    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:14.337655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.324874    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:14.708168 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.706219    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:14.892953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:14.855255    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:15.189196 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.189147    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:15.310236 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.256565    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:15.597064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.261904    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:15.597389 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.339710    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:15.597977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.346256    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:15.929952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:15.926120    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:16.230227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.230104    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:16.353196 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.353147    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 22:04:16.449953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.446272    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:16.473106 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.473059    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:16.546020 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.491006    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:16.546020 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.491093    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:16.624957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.618394    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:16.624957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.618587    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:16.931954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:16.929980    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.123236 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.123190    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.233018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.231919    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.241955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.241026    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:17.241955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.241087    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.624043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.623146    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.627952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.624674    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.665166 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.665115    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:17.665484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.665439    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.735591 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.735340    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:17.804838 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:17.804788    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.020257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.020211    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.084898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.084862    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:18.144595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.144555    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.218099 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.218062    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:18.226143 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.226098    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.252093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.245398    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:18.413954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.405583    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:18.413954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.405711    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.554378 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.554255    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-2b5rt" podUID="22006b91-c2f8-41d9-8f61-40a8cbeb5942" containerName="cert-manager-webhook" probeResult="failure" output="Get \"http://10.134.0.32:6080/livez\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.582949 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.582613    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:18.582949 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.582680    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:18.627765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.627086    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:18.695082 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.685999    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:18.738091 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.737635    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 22:04:18.807134 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.799613    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:18.823846 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.823819    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:18.881587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:18.881560    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:19.141919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:19.130271    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:19.232622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:19.232587    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:39.445954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.432551    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:04:39.457024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.455371    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.751968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.745513    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.751968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.745602    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.751968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.745803    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.751968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.745851    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.751968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.745892    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.762352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.762284    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.762702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.762678    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.762979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.762908    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.763212 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.763193    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2tv\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.798077 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.798008    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875586    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875653    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875799    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875836    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875858    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.876220    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.876765    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.917974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.877385    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.944979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.875921    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.944979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.918656    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.944979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.918702    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.944979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.918782    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2tv\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.944979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.926179    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.947382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.947351    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.954031 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.947905    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.962307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.962276    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:39.969124 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:39.969097    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:40.050057 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.041268    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2tv\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\") pod \"e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") " pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:40.159366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.159334    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:40.657955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.657066    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:40.706953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.700143    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:40.744964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.735504    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:40.744964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:40.735846    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:41.692955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.691221    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:41.692955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.692025    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:41.810954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.803128    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:41.810954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.803573    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:41.810954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.803918    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:41.810954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.805120    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:41.810954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.805450    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:41.820224 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.820192    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:04:41.945878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.914083    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:04:41.945878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.914178    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:04:41.945878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.914224    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:04:41.945878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:41.872014    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Oct 30 22:04:41.945878 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:04:41.880009    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbeb95ce_91bd_482f_84f7_bed3880f11a3.slice/crio-2ce22d1a9344c87305d6b6fcdf75cd1ba8fef5f5bc8506fe01cc11d46bacda67 WatchSource:0}: Error finding container 2ce22d1a9344c87305d6b6fcdf75cd1ba8fef5f5bc8506fe01cc11d46bacda67: Status 404 returned error can't find the container with id 2ce22d1a9344c87305d6b6fcdf75cd1ba8fef5f5bc8506fe01cc11d46bacda67
Oct 30 22:04:42.747955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.721661    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:42.747955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.722859    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:42.816154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.816097    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:42.817212 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.816479    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:42.950969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.941033    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:42.950969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.941508    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:42.950969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:42.948921    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:43.066077 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.066040    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" event={"ID":"cbeb95ce-91bd-482f-84f7-bed3880f11a3","Type":"ContainerStarted","Data":"2ce22d1a9344c87305d6b6fcdf75cd1ba8fef5f5bc8506fe01cc11d46bacda67"}
Oct 30 22:04:43.520030 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.338798    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:43.566047 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:04:43.360374    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:04:43.751078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.751034    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:43.752029 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.752005    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:43.776331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.776246    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:43.821078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:43.819292    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:44.258123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.258080    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:44.684956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.644784    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" event={"ID":"cbeb95ce-91bd-482f-84f7-bed3880f11a3","Type":"ContainerStarted","Data":"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"}
Oct 30 22:04:44.837841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.783419    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:44.837841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.783496    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:44.847957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.807325    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:44.847957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:44.840581    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:45.067031 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.062514    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podStartSLOduration=6.062487616 podStartE2EDuration="6.062487616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:44.813580898 +0000 UTC m=+1289.783427312" watchObservedRunningTime="2026-10-30 22:04:45.062487616 +0000 UTC m=+1290.032334026"
Oct 30 22:04:45.211956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.204095    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:45.211956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.204173    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:45.268139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.268090    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:45.286473 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.286427    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:45.446712 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.446679    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:45.447063 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.447042    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:45.851331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.851232    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Oct 30 22:04:45.852250 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.852216    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:45.854865 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.852423    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:45.855296 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.852492    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:45.855452 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:45.853950    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 22:04:46.249449 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.249409    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:46.275579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.275516    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:46.297076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.294069    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.326330 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.326285    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:46.326709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.326584    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.397021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.393029    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:46.452524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.452477    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.555563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.544338    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:46.555563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.544398    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.685140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.685101    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7185-5c4b82"]
Oct 30 22:04:46.734955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.705821    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:04:46.750954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.740426    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5shl\" (UniqueName: \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\") pod \"test-curl-7185-5c4b82\" (UID: \"6e45f61a-be7c-49dd-b2d9-919532fe4777\") " pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:04:46.864462 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.864419    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.866531 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.866496    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:46.871054 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.871021    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:46.900998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.872167    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 30 22:04:46.900998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.872463    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:46.900998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.874153    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5shl\" (UniqueName: \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\") pod \"test-curl-7185-5c4b82\" (UID: \"6e45f61a-be7c-49dd-b2d9-919532fe4777\") " pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:04:46.936404 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.906574    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-5c4b82"]
Oct 30 22:04:47.091238 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:46.998558    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-74ld5\""
Oct 30 22:04:47.218956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.185109    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/health\": context deadline exceeded"
Oct 30 22:04:47.238694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.238645    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:47.287407 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.287209    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:47.338951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.329900    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:04:47.460145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.460100    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:47.806773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.806676    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:04:47.807253 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.807113    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:47.918972 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.895676    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:04:47.918972 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.896088    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": context deadline exceeded"
Oct 30 22:04:47.918972 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.916483    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Oct 30 22:04:47.918972 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.917018    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:04:48.008990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:47.997744    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5shl\" (UniqueName: \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\") pod \"test-curl-7185-5c4b82\" (UID: \"6e45f61a-be7c-49dd-b2d9-919532fe4777\") " pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:04:48.008990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.001460    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:04:48.064902 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.064111    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:04:48.067102 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.067071    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:04:48.068312 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.067808    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:04:48.088491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.088464    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:04:48.161072 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.161032    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:48.161252 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.161093    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:48.171122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.171086    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:04:48.586872 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.586840    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-5c4b82"]
Oct 30 22:04:48.592445 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:04:48.592415    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e45f61a_be7c_49dd_b2d9_919532fe4777.slice/crio-b0fbc12ddf460b4ae25e025b9c1e3780b6ed48f1eb858c64130c468083b8dd84 WatchSource:0}: Error finding container b0fbc12ddf460b4ae25e025b9c1e3780b6ed48f1eb858c64130c468083b8dd84: Status 404 returned error can't find the container with id b0fbc12ddf460b4ae25e025b9c1e3780b6ed48f1eb858c64130c468083b8dd84
Oct 30 22:04:48.594897 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.594879    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:04:48.658855 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:48.658729    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-5c4b82" event={"ID":"6e45f61a-be7c-49dd-b2d9-919532fe4777","Type":"ContainerStarted","Data":"b0fbc12ddf460b4ae25e025b9c1e3780b6ed48f1eb858c64130c468083b8dd84"}
Oct 30 22:04:49.160947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:49.160892    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:49.161362 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:49.161043    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:50.160975 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:50.160938    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:50.161342 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:50.160989    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:50.675091 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:50.675056    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-5c4b82" event={"ID":"6e45f61a-be7c-49dd-b2d9-919532fe4777","Type":"ContainerStarted","Data":"7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27"}
Oct 30 22:04:50.808273 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:50.808215    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7185-5c4b82" podStartSLOduration=3.422152363 podStartE2EDuration="4.808199551s" totalImagesPullingTime="1.386047188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:50.803442104 +0000 UTC m=+1295.773288512" watchObservedRunningTime="2026-10-30 22:04:50.808199551 +0000 UTC m=+1295.778045964"
Oct 30 22:04:51.160981 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:51.160950    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:51.161405 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:51.161001    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:52.160966 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:52.160891    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:52.161180 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:52.160969    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:53.161101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:53.161059    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:04:53.161321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:53.161122    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 22:04:54.165408 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:54.165375    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:54.165877 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:54.165734    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:04:54.166465 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:04:54.166442    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:05:02.469390 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:02.469340    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7185-5c4b82"]
Oct 30 22:05:02.469922 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:02.469574    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7185-5c4b82" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" containerName="test-curl-7185-5c4b82" containerID="cri-o://7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27" gracePeriod=2
Oct 30 22:05:02.473568 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:02.473537    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7185-5c4b82"]
Oct 30 22:05:02.518374 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:02.518323    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-5c4b82\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:05:04.737540 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.737473    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:05:04.787801 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.787763    5579 generic.go:356] "Generic (PLEG): container finished" podID="6e45f61a-be7c-49dd-b2d9-919532fe4777" containerID="7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27" exitCode=137
Oct 30 22:05:04.788014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.787809    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:05:04.788014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.787860    5579 scope.go:122] "RemoveContainer" containerID="7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27"
Oct 30 22:05:04.793416 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.793390    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\" (UniqueName: \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\") pod \"6e45f61a-be7c-49dd-b2d9-919532fe4777\" (UID: \"6e45f61a-be7c-49dd-b2d9-919532fe4777\") "
Oct 30 22:05:04.795588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.795561    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl" pod "6e45f61a-be7c-49dd-b2d9-919532fe4777" (UID: "6e45f61a-be7c-49dd-b2d9-919532fe4777"). InnerVolumeSpecName "kube-api-access-k5shl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:04.798127 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.798104    5579 scope.go:122] "RemoveContainer" containerID="7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27"
Oct 30 22:05:04.798436 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:04.798412    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27\": container with ID starting with 7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27 not found: ID does not exist" containerID="7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27"
Oct 30 22:05:04.798511 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.798439    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27"} err="failed to get container status \"7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27\": rpc error: code = NotFound desc = could not find container \"7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27\": container with ID starting with 7a93e4bf698239219135f9d7aeff980e336ecf7000d300af038d85a25ca56b27 not found: ID does not exist"
Oct 30 22:05:04.895689 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:04.895641    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5shl\" (UniqueName: \"kubernetes.io/projected/6e45f61a-be7c-49dd-b2d9-919532fe4777-kube-api-access-k5shl\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:05:05.146412 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:05.146372    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-5c4b82\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:05:05.151774 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:05.151745    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" path="/var/lib/kubelet/pods/6e45f61a-be7c-49dd-b2d9-919532fe4777/volumes"
Oct 30 22:05:05.198717 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:05.198676    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-5c4b82\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" pod="opendatahub/test-curl-7185-5c4b82"
Oct 30 22:05:12.930593 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:12.930559    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:05:24.916165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:24.916099    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:25.011097 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:25.011045    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:25.070068 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:25.070017    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:26.200111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.191955    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:05:26.200111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.193088    5579 cpu_manager.go:414] "containerMap: removing container" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" containerName="test-curl-7185-5c4b82"
Oct 30 22:05:26.200111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.193127    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" containerName="test-curl-7185-5c4b82"
Oct 30 22:05:26.200111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.193280    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e45f61a-be7c-49dd-b2d9-919532fe4777" containerName="test-curl-7185-5c4b82"
Oct 30 22:05:26.200111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.199167    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.429588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.417690    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:05:26.804955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.438431    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b3084d7f-serving-cert\""
Oct 30 22:05:26.804955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.648043    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24rn\" (UniqueName: \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.804955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.769081    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.804955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.779699    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.807043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.806734    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.930953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.926000    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:26.944831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.934074    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24rn\" (UniqueName: \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.944831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.934196    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:26.944831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:26.934469    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.084451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.084371    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24rn\" (UniqueName: \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.090951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.085980    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.096666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.093908    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.111985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.105774    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.111985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.107321    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:27.130001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.117671    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\") pod \"maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:27.214980 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.208076    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:27.259288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.259238    5579 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:27.308953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:27.305414    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:28.046898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:28.046802    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:05:28.051330 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:05:28.051293    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3f0335_46d3_4b1c_a366_54147e665ef4.slice/crio-90bf117f129ddb0b3a185df0c590962397a377d2fd15aa41669c46f2a6d0c2fd WatchSource:0}: Error finding container 90bf117f129ddb0b3a185df0c590962397a377d2fd15aa41669c46f2a6d0c2fd: Status 404 returned error can't find the container with id 90bf117f129ddb0b3a185df0c590962397a377d2fd15aa41669c46f2a6d0c2fd
Oct 30 22:05:28.901336 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:28.901299    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" event={"ID":"db3f0335-46d3-4b1c-a366-54147e665ef4","Type":"ContainerStarted","Data":"90bf117f129ddb0b3a185df0c590962397a377d2fd15aa41669c46f2a6d0c2fd"}
Oct 30 22:05:29.912119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:29.912066    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" event={"ID":"db3f0335-46d3-4b1c-a366-54147e665ef4","Type":"ContainerStarted","Data":"7a6de92d87f555c7738ffb8d05b8ec687e718f4ba5c8fab0cc5bf0f212da4234"}
Oct 30 22:05:29.912637 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:29.912236    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:30.025462 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:30.025408    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" podStartSLOduration=3.1633382660000002 podStartE2EDuration="4.02539462s" totalImagesPullingTime="862.056354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:30.022708615 +0000 UTC m=+1334.992555033" watchObservedRunningTime="2026-10-30 22:05:30.02539462 +0000 UTC m=+1334.995241029"
Oct 30 22:05:35.927088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:35.927057    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:05:42.930502 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:42.930467    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:05:49.575065 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.575030    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:05:49.579431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.579403    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.601670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.601638    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.601835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.601683    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2b54\" (UniqueName: \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.601878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.601858    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.601978 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.601962    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.628222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.628190    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3bf5aa7a-serving-cert\""
Oct 30 22:05:49.679148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.679108    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:05:49.704015 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.703983    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.704259 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:49.704159    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-serving-cert: secret "maas-api-e2e-ait-3bf5aa7a-serving-cert" not found
Oct 30 22:05:49.704400 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:49.704361    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls podName:8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5 nodeName:}" failed. No retries permitted until 2026-10-30 22:05:50.20429586 +0000 UTC m=+1355.174142250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls") pod "maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" (UID: "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5") : secret "maas-api-e2e-ait-3bf5aa7a-serving-cert" not found
Oct 30 22:05:49.704400 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.704400    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2b54\" (UniqueName: \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.705385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.704545    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.705385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.704632    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.706574 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.705845    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.707947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.707907    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:49.761669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:49.761641    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2b54\" (UniqueName: \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:50.212463 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:50.212429    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:50.215171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:50.215141    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") pod \"maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:50.493074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:50.492976    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:50.867158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:50.867075    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:05:50.875816 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:05:50.875787    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7bd9d5_6741_48d3_907a_a1dbc0f66fe5.slice/crio-0657ee7e535399f1aeb9a023d357c112aa8e4a32c3ba64203eeda24d8684d7c2 WatchSource:0}: Error finding container 0657ee7e535399f1aeb9a023d357c112aa8e4a32c3ba64203eeda24d8684d7c2: Status 404 returned error can't find the container with id 0657ee7e535399f1aeb9a023d357c112aa8e4a32c3ba64203eeda24d8684d7c2
Oct 30 22:05:51.067889 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:51.067851    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" event={"ID":"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5","Type":"ContainerStarted","Data":"0657ee7e535399f1aeb9a023d357c112aa8e4a32c3ba64203eeda24d8684d7c2"}
Oct 30 22:05:52.076849 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:52.076745    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" event={"ID":"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5","Type":"ContainerStarted","Data":"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"}
Oct 30 22:05:52.077292 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:52.076981    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:52.185878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:52.185823    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" podStartSLOduration=2.280070647 podStartE2EDuration="3.185808704s" totalImagesPullingTime="905.738057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:52.184942391 +0000 UTC m=+1357.154788792" watchObservedRunningTime="2026-10-30 22:05:52.185808704 +0000 UTC m=+1357.155655113"
Oct 30 22:05:58.089727 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.089651    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:05:58.656867 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.656834    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:05:58.662015 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.661994    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.711914 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.711876    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-50ff7514-serving-cert\""
Oct 30 22:05:58.719974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.719919    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:05:58.736102 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.736070    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsg7\" (UniqueName: \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.736361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.736324    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.736503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.736381    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.736573 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.736539    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.837720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.837686    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsg7\" (UniqueName: \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.837896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.837781    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.837896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.837801    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.837999 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.837903    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.838044 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:58.838022    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-serving-cert: secret "maas-api-e2e-ait-50ff7514-serving-cert" not found
Oct 30 22:05:58.838110 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:05:58.838099    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls podName:141e907e-6cc9-4d4c-9885-cc98c9ddec94 nodeName:}" failed. No retries permitted until 2026-10-30 22:05:59.338081509 +0000 UTC m=+1364.307927916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls") pod "maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" (UID: "141e907e-6cc9-4d4c-9885-cc98c9ddec94") : secret "maas-api-e2e-ait-50ff7514-serving-cert" not found
Oct 30 22:05:58.838486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.838464    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.840371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.840345    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:58.892290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:58.892257    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsg7\" (UniqueName: \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:59.346250 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:59.346215    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:59.348602 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:59.348581    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") pod \"maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:59.576329 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:59.576298    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:05:59.949155 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:05:59.949114    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:05:59.954188 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:05:59.954157    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141e907e_6cc9_4d4c_9885_cc98c9ddec94.slice/crio-d0115d53cd51ac30bf4302659f5dd2f69778c713cbc037fe182b26e1d60a0ebe WatchSource:0}: Error finding container d0115d53cd51ac30bf4302659f5dd2f69778c713cbc037fe182b26e1d60a0ebe: Status 404 returned error can't find the container with id d0115d53cd51ac30bf4302659f5dd2f69778c713cbc037fe182b26e1d60a0ebe
Oct 30 22:06:00.132433 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:00.132396    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" event={"ID":"141e907e-6cc9-4d4c-9885-cc98c9ddec94","Type":"ContainerStarted","Data":"d0115d53cd51ac30bf4302659f5dd2f69778c713cbc037fe182b26e1d60a0ebe"}
Oct 30 22:06:01.157578 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:01.156091    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" event={"ID":"141e907e-6cc9-4d4c-9885-cc98c9ddec94","Type":"ContainerStarted","Data":"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"}
Oct 30 22:06:01.157578 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:01.156158    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:06:01.300648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:01.300545    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" podStartSLOduration=2.268875026 podStartE2EDuration="3.300530732s" totalImagesPullingTime="1.031655706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:01.298536022 +0000 UTC m=+1366.268382430" watchObservedRunningTime="2026-10-30 22:06:01.300530732 +0000 UTC m=+1366.270377140"
Oct 30 22:06:07.164514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:07.164485    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:06:12.930676 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:06:12.930636    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:06:42.930966 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:06:42.930908    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:06:49.846569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.846532    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:06:49.851250 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.851227    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.953559 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.953525    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:06:49.957659 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.957626    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.957804 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.957665    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rhgh\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.957853 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.957828    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.957966 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.957921    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.958045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.958023    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.958146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.958123    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.958219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.958206    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.958268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.958254    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.958327 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.958316    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:49.987111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:49.987077    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-50ff7514-openshift-default-dockercfg-g859w\""
Oct 30 22:06:50.060165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060130    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060347 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060298    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060396 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060344    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060424    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060476 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060460    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060538 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060524    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060592 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060581    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060646 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060603    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rhgh\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060616    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060751 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060692    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060751 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060727    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.060882 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.060858    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.061098 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.061073    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.061748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.061723    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.062768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.062745    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.063240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.063221    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.114824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.114724    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.115088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.115063    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rhgh\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.165797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.165761    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:50.606714 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.606678    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:06:50.644879 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:06:50.644848    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d2d22_9ce9_4bdf_a701_cbfd6ff12902.slice/crio-f500a9931c5658c1e38b3cbe5e037e63015570e44c75aef220be639393dba4dc WatchSource:0}: Error finding container f500a9931c5658c1e38b3cbe5e037e63015570e44c75aef220be639393dba4dc: Status 404 returned error can't find the container with id f500a9931c5658c1e38b3cbe5e037e63015570e44c75aef220be639393dba4dc
Oct 30 22:06:50.647485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.647449    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:06:50.647569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.647523    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:06:50.647569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:50.647552    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:06:51.613859 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:51.613820    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" event={"ID":"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902","Type":"ContainerStarted","Data":"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"}
Oct 30 22:06:51.614366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:51.613891    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" event={"ID":"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902","Type":"ContainerStarted","Data":"f500a9931c5658c1e38b3cbe5e037e63015570e44c75aef220be639393dba4dc"}
Oct 30 22:06:51.776460 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:51.776400    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podStartSLOduration=2.77638461 podStartE2EDuration="2.77638461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:51.771554836 +0000 UTC m=+1416.741401245" watchObservedRunningTime="2026-10-30 22:06:51.77638461 +0000 UTC m=+1416.746231019"
Oct 30 22:06:52.166149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:52.166120    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:52.168088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:52.168062    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 22:06:52.168222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:52.168109    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 22:06:53.166523 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:53.166490    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 22:06:53.166911 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:53.166541    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 22:06:54.166593 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:54.166554    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 22:06:54.167045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:54.166622    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 22:06:55.166713 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:55.166675    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 22:06:55.167198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:55.166734    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 22:06:56.166806 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:56.166768    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Oct 30 22:06:56.167294 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:56.166827    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Oct 30 22:06:57.325278 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:57.325243    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:57.325991 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:57.325965    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:06:57.326973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:06:57.326923    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:07:07.466897 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.466858    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:07:07.467483 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.467139    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" podUID="db3f0335-46d3-4b1c-a366-54147e665ef4" containerName="maas-api" containerID="cri-o://7a6de92d87f555c7738ffb8d05b8ec687e718f4ba5c8fab0cc5bf0f212da4234" gracePeriod=30
Oct 30 22:07:07.770790 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.770699    5579 generic.go:356] "Generic (PLEG): container finished" podID="db3f0335-46d3-4b1c-a366-54147e665ef4" containerID="7a6de92d87f555c7738ffb8d05b8ec687e718f4ba5c8fab0cc5bf0f212da4234" exitCode=0
Oct 30 22:07:07.771028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.770778    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" event={"ID":"db3f0335-46d3-4b1c-a366-54147e665ef4","Type":"ContainerDied","Data":"7a6de92d87f555c7738ffb8d05b8ec687e718f4ba5c8fab0cc5bf0f212da4234"}
Oct 30 22:07:07.817832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.817803    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:07:07.950702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.950662    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\" (UniqueName: \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\") pod \"db3f0335-46d3-4b1c-a366-54147e665ef4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") "
Oct 30 22:07:07.951047 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.951025    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\") pod \"db3f0335-46d3-4b1c-a366-54147e665ef4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") "
Oct 30 22:07:07.951214 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.951186    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\") pod \"db3f0335-46d3-4b1c-a366-54147e665ef4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") "
Oct 30 22:07:07.951504 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.951489    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\") pod \"db3f0335-46d3-4b1c-a366-54147e665ef4\" (UID: \"db3f0335-46d3-4b1c-a366-54147e665ef4\") "
Oct 30 22:07:07.953601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.953564    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca" pod "db3f0335-46d3-4b1c-a366-54147e665ef4" (UID: "db3f0335-46d3-4b1c-a366-54147e665ef4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:07.956435 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.956407    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls" pod "db3f0335-46d3-4b1c-a366-54147e665ef4" (UID: "db3f0335-46d3-4b1c-a366-54147e665ef4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:07.980753 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.966452    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs" pod "db3f0335-46d3-4b1c-a366-54147e665ef4" (UID: "db3f0335-46d3-4b1c-a366-54147e665ef4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:07.997079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:07.996804    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn" pod "db3f0335-46d3-4b1c-a366-54147e665ef4" (UID: "db3f0335-46d3-4b1c-a366-54147e665ef4"). InnerVolumeSpecName "kube-api-access-d24rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:08.053665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.053583    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d24rn\" (UniqueName: \"kubernetes.io/projected/db3f0335-46d3-4b1c-a366-54147e665ef4-kube-api-access-d24rn\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:08.053665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.053619    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:08.053665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.053629    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3f0335-46d3-4b1c-a366-54147e665ef4-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:08.053665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.053638    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db3f0335-46d3-4b1c-a366-54147e665ef4-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:08.780563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.780476    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"
Oct 30 22:07:08.780563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.780494    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4" event={"ID":"db3f0335-46d3-4b1c-a366-54147e665ef4","Type":"ContainerDied","Data":"90bf117f129ddb0b3a185df0c590962397a377d2fd15aa41669c46f2a6d0c2fd"}
Oct 30 22:07:08.780563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.780563    5579 scope.go:122] "RemoveContainer" containerID="7a6de92d87f555c7738ffb8d05b8ec687e718f4ba5c8fab0cc5bf0f212da4234"
Oct 30 22:07:08.936999 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.936953    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:07:08.984799 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:08.984762    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b3084d7f-5f587d6c67-8g6x4"]
Oct 30 22:07:09.148159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:09.148128    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db3f0335-46d3-4b1c-a366-54147e665ef4" path="/var/lib/kubelet/pods/db3f0335-46d3-4b1c-a366-54147e665ef4/volumes"
Oct 30 22:07:12.934430 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:12.934386    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:07:19.665356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.660310    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:07:19.665356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.661368    5579 cpu_manager.go:414] "containerMap: removing container" podUID="db3f0335-46d3-4b1c-a366-54147e665ef4" containerName="maas-api"
Oct 30 22:07:19.665356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.661389    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db3f0335-46d3-4b1c-a366-54147e665ef4" containerName="maas-api"
Oct 30 22:07:19.665356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.661543    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="db3f0335-46d3-4b1c-a366-54147e665ef4" containerName="maas-api"
Oct 30 22:07:19.677228 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.677203    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.721119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.721082    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:07:19.762039 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.761981    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-13297892-dockercfg-9dq84\""
Oct 30 22:07:19.762482 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.762459    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-13297892\""
Oct 30 22:07:19.780984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.780173    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zpr\" (UniqueName: \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.780984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.780421    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.881387 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.881353    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.881560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.881443    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zpr\" (UniqueName: \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.882365 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.882337    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.935343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.935270    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zpr\" (UniqueName: \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\") pod \"payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") " pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:19.998178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:19.998143    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:20.375844 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:20.375755    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:07:20.381027 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:07:20.380998    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab9f88_3a09_45b7_a8e5_4d71c92b77a3.slice/crio-abeb1ec88766bbe2b0e869fe2f4db63a233bfc8cc04b8c72ba0dc8cb58bcaaf3 WatchSource:0}: Error finding container abeb1ec88766bbe2b0e869fe2f4db63a233bfc8cc04b8c72ba0dc8cb58bcaaf3: Status 404 returned error can't find the container with id abeb1ec88766bbe2b0e869fe2f4db63a233bfc8cc04b8c72ba0dc8cb58bcaaf3
Oct 30 22:07:20.880964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:20.880918    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" event={"ID":"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3","Type":"ContainerStarted","Data":"abeb1ec88766bbe2b0e869fe2f4db63a233bfc8cc04b8c72ba0dc8cb58bcaaf3"}
Oct 30 22:07:23.905396 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:23.905355    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" event={"ID":"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3","Type":"ContainerStarted","Data":"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"}
Oct 30 22:07:23.905828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:23.905509    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:24.016045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:24.015986    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" podStartSLOduration=2.26641872 podStartE2EDuration="5.015972111s" totalImagesPullingTime="2.749553391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:24.013889453 +0000 UTC m=+1448.983735861" watchObservedRunningTime="2026-10-30 22:07:24.015972111 +0000 UTC m=+1448.985818561"
Oct 30 22:07:28.199880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.199785    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:07:28.200298 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.200038    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" podUID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" containerName="maas-api" containerID="cri-o://ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e" gracePeriod=30
Oct 30 22:07:28.525625 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.525579    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:07:28.614728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.614691    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\" (UniqueName: \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\") pod \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") "
Oct 30 22:07:28.614925 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.614834    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\") pod \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") "
Oct 30 22:07:28.614925 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.614881    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") pod \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") "
Oct 30 22:07:28.614925 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.614915    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\") pod \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\" (UID: \"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5\") "
Oct 30 22:07:28.615366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.615334    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca" pod "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" (UID: "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:28.615594 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.615574    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:28.617077 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.617050    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs" pod "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" (UID: "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:28.617252 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.617228    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls" pod "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" (UID: "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:28.618096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.618071    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54" pod "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" (UID: "8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5"). InnerVolumeSpecName "kube-api-access-l2b54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:28.716526 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.716495    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:28.716526 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.716526    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:28.716776 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.716540    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2b54\" (UniqueName: \"kubernetes.io/projected/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5-kube-api-access-l2b54\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:28.942970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.942916    5579 generic.go:356] "Generic (PLEG): container finished" podID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" containerID="ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e" exitCode=0
Oct 30 22:07:28.943170 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.942983    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"
Oct 30 22:07:28.943170 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.943019    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" event={"ID":"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5","Type":"ContainerDied","Data":"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"}
Oct 30 22:07:28.943170 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.943092    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7" event={"ID":"8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5","Type":"ContainerDied","Data":"0657ee7e535399f1aeb9a023d357c112aa8e4a32c3ba64203eeda24d8684d7c2"}
Oct 30 22:07:28.943170 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.943120    5579 scope.go:122] "RemoveContainer" containerID="ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"
Oct 30 22:07:28.959959 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.959921    5579 scope.go:122] "RemoveContainer" containerID="ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"
Oct 30 22:07:28.960309 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:28.960277    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e\": container with ID starting with ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e not found: ID does not exist" containerID="ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"
Oct 30 22:07:28.960377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:28.960325    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e"} err="failed to get container status \"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e\": rpc error: code = NotFound desc = could not find container \"ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e\": container with ID starting with ee51d1a33da1836b44c5148fe2eff9dcb5decdf3619206af87520f3366c9b40e not found: ID does not exist"
Oct 30 22:07:29.108038 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:29.107979    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:07:29.141950 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:29.139114    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3bf5aa7a-5f94d59459-k7sw7"]
Oct 30 22:07:29.158351 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:29.158317    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" path="/var/lib/kubelet/pods/8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5/volumes"
Oct 30 22:07:34.249686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.249644    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:07:34.250149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.249893    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" podUID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" containerName="maas-api" containerID="cri-o://6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c" gracePeriod=30
Oct 30 22:07:34.591002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.590970    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:07:34.718668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.716756    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") pod \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") "
Oct 30 22:07:34.718668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.716980    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\") pod \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") "
Oct 30 22:07:34.718668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.717050    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\") pod \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") "
Oct 30 22:07:34.718668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.717114    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\" (UniqueName: \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\") pod \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\" (UID: \"141e907e-6cc9-4d4c-9885-cc98c9ddec94\") "
Oct 30 22:07:34.718668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.718505    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca" pod "141e907e-6cc9-4d4c-9885-cc98c9ddec94" (UID: "141e907e-6cc9-4d4c-9885-cc98c9ddec94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:34.719317 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.719298    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/141e907e-6cc9-4d4c-9885-cc98c9ddec94-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:34.721851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.721827    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs" pod "141e907e-6cc9-4d4c-9885-cc98c9ddec94" (UID: "141e907e-6cc9-4d4c-9885-cc98c9ddec94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:34.723485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.723460    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls" pod "141e907e-6cc9-4d4c-9885-cc98c9ddec94" (UID: "141e907e-6cc9-4d4c-9885-cc98c9ddec94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:07:34.723577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.723466    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7" pod "141e907e-6cc9-4d4c-9885-cc98c9ddec94" (UID: "141e907e-6cc9-4d4c-9885-cc98c9ddec94"). InnerVolumeSpecName "kube-api-access-zfsg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:34.820604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.820525    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:34.820604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.820558    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfsg7\" (UniqueName: \"kubernetes.io/projected/141e907e-6cc9-4d4c-9885-cc98c9ddec94-kube-api-access-zfsg7\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:34.820604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.820572    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/141e907e-6cc9-4d4c-9885-cc98c9ddec94-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:34.917498 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:34.917470    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:07:35.008748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.008709    5579 generic.go:356] "Generic (PLEG): container finished" podID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" containerID="6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c" exitCode=0
Oct 30 22:07:35.008971 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.008866    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" event={"ID":"141e907e-6cc9-4d4c-9885-cc98c9ddec94","Type":"ContainerDied","Data":"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"}
Oct 30 22:07:35.008971 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.008919    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx" event={"ID":"141e907e-6cc9-4d4c-9885-cc98c9ddec94","Type":"ContainerDied","Data":"d0115d53cd51ac30bf4302659f5dd2f69778c713cbc037fe182b26e1d60a0ebe"}
Oct 30 22:07:35.008971 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.008968    5579 scope.go:122] "RemoveContainer" containerID="6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"
Oct 30 22:07:35.009250 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.009124    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"
Oct 30 22:07:35.026705 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.026685    5579 scope.go:122] "RemoveContainer" containerID="6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"
Oct 30 22:07:35.027195 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:35.027159    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c\": container with ID starting with 6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c not found: ID does not exist" containerID="6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"
Oct 30 22:07:35.027316 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.027201    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c"} err="failed to get container status \"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c\": rpc error: code = NotFound desc = could not find container \"6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c\": container with ID starting with 6770a656a7217dbd05fd0b582f8ada983566dc9f25199f7f158a4e5c5e9fa01c not found: ID does not exist"
Oct 30 22:07:35.138399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.138358    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:07:35.149014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.148984    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ff7514-54666d9c57-bwhwx"]
Oct 30 22:07:35.194314 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.194284    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:35.194879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.194866    5579 cpu_manager.go:414] "containerMap: removing container" podUID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" containerName="maas-api"
Oct 30 22:07:35.194924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.194880    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" containerName="maas-api"
Oct 30 22:07:35.194924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.194919    5579 cpu_manager.go:414] "containerMap: removing container" podUID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" containerName="maas-api"
Oct 30 22:07:35.194924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.194925    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" containerName="maas-api"
Oct 30 22:07:35.195042 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.195032    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f7bd9d5-6741-48d3-907a-a1dbc0f66fe5" containerName="maas-api"
Oct 30 22:07:35.195076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.195048    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" containerName="maas-api"
Oct 30 22:07:35.200178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.200160    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.262742 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.262692    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:35.328657 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328615    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.328832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328692    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.328832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328751    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328831    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328856    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.328961    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.329084    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj65h\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.329143    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.329249 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.329212    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.430765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.430659    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.430919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.430796    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj65h\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.430919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.430852    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431047 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.430917    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431047 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431010    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431117 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431063    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431125    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431157    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431225    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.431276 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431257    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.432007 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.431974    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.432188 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.432028    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.432345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.432298    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.432598 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.432547    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.434461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.434429    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.435853 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.435833    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.485230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.485196    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.485403 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.485320    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj65h\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\") pod \"e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") " pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.513601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.513571    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:35.967884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.967845    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:35.972790 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:07:35.972752    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf940721_d1d2_461d_8894_faaea2046906.slice/crio-28cba84b79fc4e4b62f7c0c18eee3c81b36ac6bf97d857743f9a1338250059fb WatchSource:0}: Error finding container 28cba84b79fc4e4b62f7c0c18eee3c81b36ac6bf97d857743f9a1338250059fb: Status 404 returned error can't find the container with id 28cba84b79fc4e4b62f7c0c18eee3c81b36ac6bf97d857743f9a1338250059fb
Oct 30 22:07:35.975535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.975495    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:07:35.975624 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.975585    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:07:35.975669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:35.975630    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:07:36.020122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:36.020085    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" event={"ID":"af940721-d1d2-461d-8894-faaea2046906","Type":"ContainerStarted","Data":"28cba84b79fc4e4b62f7c0c18eee3c81b36ac6bf97d857743f9a1338250059fb"}
Oct 30 22:07:37.054587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.054551    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" event={"ID":"af940721-d1d2-461d-8894-faaea2046906","Type":"ContainerStarted","Data":"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"}
Oct 30 22:07:37.156779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.156746    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="141e907e-6cc9-4d4c-9885-cc98c9ddec94" path="/var/lib/kubelet/pods/141e907e-6cc9-4d4c-9885-cc98c9ddec94/volumes"
Oct 30 22:07:37.218205 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.218151    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" podStartSLOduration=2.218137806 podStartE2EDuration="2.218137806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:37.21360737 +0000 UTC m=+1462.183453778" watchObservedRunningTime="2026-10-30 22:07:37.218137806 +0000 UTC m=+1462.187984215"
Oct 30 22:07:37.514043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.514005    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:37.515479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.515451    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 22:07:37.515595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:37.515504    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 22:07:38.514060 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:38.514025    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 22:07:38.514663 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:38.514095    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 22:07:38.580818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:38.580774    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:07:38.581097 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:38.581065    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" containerID="cri-o://09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4" gracePeriod=30
Oct 30 22:07:38.608345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:38.608305    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:39.075581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.075534    5579 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" secret="" err="secret \"e2e-ait-50ff7514-openshift-default-dockercfg-g859w\" not found"
Oct 30 22:07:39.261631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.261574    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:07:39.269884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.269856    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.312179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.312121    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:07:39.320168 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.320135    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-de9c059f\""
Oct 30 22:07:39.320316 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.320211    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-de9c059f-dockercfg-7j42f\""
Oct 30 22:07:39.448335 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.447965    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.452308 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.452265    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj792\" (UniqueName: \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.514706 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.514668    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 22:07:39.515456 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.514725    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 22:07:39.559514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.558152    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.559514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.558295    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj792\" (UniqueName: \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.559514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.559478    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.614045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.614013    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj792\" (UniqueName: \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\") pod \"payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:39.892090 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:39.889365    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:40.085732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:40.084087    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy" containerID="cri-o://c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b" gracePeriod=30
Oct 30 22:07:40.349037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:40.347914    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:07:40.352744 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:07:40.352713    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d255234_2e95_444c_850f_d4bdb12fc44a.slice/crio-18e55d009e1ccab76161fd33194205a227636ec10930f8e42eaa01737cc8f798 WatchSource:0}: Error finding container 18e55d009e1ccab76161fd33194205a227636ec10930f8e42eaa01737cc8f798: Status 404 returned error can't find the container with id 18e55d009e1ccab76161fd33194205a227636ec10930f8e42eaa01737cc8f798
Oct 30 22:07:41.092540 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:41.092508    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" event={"ID":"5d255234-2e95-444c-850f-d4bdb12fc44a","Type":"ContainerStarted","Data":"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"}
Oct 30 22:07:41.092968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:41.092557    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" event={"ID":"5d255234-2e95-444c-850f-d4bdb12fc44a","Type":"ContainerStarted","Data":"18e55d009e1ccab76161fd33194205a227636ec10930f8e42eaa01737cc8f798"}
Oct 30 22:07:41.092968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:41.092594    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:41.219161 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:41.219106    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" podStartSLOduration=2.219092115 podStartE2EDuration="2.219092115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:41.216055161 +0000 UTC m=+1466.185901570" watchObservedRunningTime="2026-10-30 22:07:41.219092115 +0000 UTC m=+1466.188938524"
Oct 30 22:07:42.328667 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:42.328633    5579 patch_prober.go:29] interesting pod/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:07:42.329073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:42.328717    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:07:42.930514 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:42.930481    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:07:43.856546 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.856490    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:07:43.943201 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943167    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943375 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943268    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943464 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943370    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943477    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943582 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943534    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:43.943582 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943543    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943698 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943680    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943731    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943840 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943823    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943903 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943863    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\") pod \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\" (UID: \"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902\") "
Oct 30 22:07:43.943903 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943872    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:43.944044 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.943924    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:43.944263 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944241    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:43.944352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944254    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:43.944576 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944550    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:43.944576 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944572    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:43.944576 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944581    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:43.944822 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944590    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:43.944822 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.944601    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:43.945902 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.945875    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:07:43.946011 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.945990    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:43.946139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.946119    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:43.946299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:43.946278    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh" pod "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" (UID: "a08d2d22-9ce9-4bdf-a701-cbfd6ff12902"). InnerVolumeSpecName "kube-api-access-6rhgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:44.046242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.046206    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rhgh\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-kube-api-access-6rhgh\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:44.046242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.046244    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:44.046476 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.046257    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:44.046476 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.046266    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:44.119447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.119359    5579 generic.go:356] "Generic (PLEG): container finished" podID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerID="09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4" exitCode=0
Oct 30 22:07:44.119447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.119408    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"
Oct 30 22:07:44.119447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.119437    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" event={"ID":"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902","Type":"ContainerDied","Data":"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"}
Oct 30 22:07:44.119750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.119489    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6" event={"ID":"a08d2d22-9ce9-4bdf-a701-cbfd6ff12902","Type":"ContainerDied","Data":"f500a9931c5658c1e38b3cbe5e037e63015570e44c75aef220be639393dba4dc"}
Oct 30 22:07:44.119750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.119517    5579 scope.go:122] "RemoveContainer" containerID="09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"
Oct 30 22:07:44.133259 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.133239    5579 scope.go:122] "RemoveContainer" containerID="09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"
Oct 30 22:07:44.133569 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:44.133551    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4\": container with ID starting with 09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4 not found: ID does not exist" containerID="09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"
Oct 30 22:07:44.133656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.133575    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4"} err="failed to get container status \"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4\": rpc error: code = NotFound desc = could not find container \"09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4\": container with ID starting with 09ac023781eccf73b9839839f00e1e175ef1fe1ca6730cdb58d187d52e574ed4 not found: ID does not exist"
Oct 30 22:07:44.275588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.275553    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:07:44.279189 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:44.279162    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-vvwk6"]
Oct 30 22:07:45.148779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:45.148749    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" path="/var/lib/kubelet/pods/a08d2d22-9ce9-4bdf-a701-cbfd6ff12902/volumes"
Oct 30 22:07:47.366246 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.366213    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:47.497013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.496920    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497031    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497098    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497151    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497341 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497181    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497341 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497282    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497455 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497397    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497455 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497432    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:47.497560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497447    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:47.497560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497494    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497530    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:47.497700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497590    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\") pod \"af940721-d1d2-461d-8894-faaea2046906\" (UID: \"af940721-d1d2-461d-8894-faaea2046906\") "
Oct 30 22:07:47.497775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497737    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:47.497775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.497746    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:47.498420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.498393    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.498558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.498422    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af940721-d1d2-461d-8894-faaea2046906-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.498558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.498438    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.498558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.498454    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.498558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.498468    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.499622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.499576    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:47.499730 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.499631    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:47.499730 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.499719    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "kube-api-access-zj65h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:47.499843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.499779    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo" pod "af940721-d1d2-461d-8894-faaea2046906" (UID: "af940721-d1d2-461d-8894-faaea2046906"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:07:47.600675 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.600637    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af940721-d1d2-461d-8894-faaea2046906-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.600675 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.600679    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.600871 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.600696    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af940721-d1d2-461d-8894-faaea2046906-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:47.600871 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:47.600711    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj65h\" (UniqueName: \"kubernetes.io/projected/af940721-d1d2-461d-8894-faaea2046906-kube-api-access-zj65h\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:07:48.162583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.162532    5579 generic.go:356] "Generic (PLEG): container finished" podID="af940721-d1d2-461d-8894-faaea2046906" containerID="c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b" exitCode=0
Oct 30 22:07:48.162583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.162577    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"
Oct 30 22:07:48.162818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.162602    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" event={"ID":"af940721-d1d2-461d-8894-faaea2046906","Type":"ContainerDied","Data":"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"}
Oct 30 22:07:48.162818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.162657    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr" event={"ID":"af940721-d1d2-461d-8894-faaea2046906","Type":"ContainerDied","Data":"28cba84b79fc4e4b62f7c0c18eee3c81b36ac6bf97d857743f9a1338250059fb"}
Oct 30 22:07:48.162818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.162679    5579 scope.go:122] "RemoveContainer" containerID="c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"
Oct 30 22:07:48.173549 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.173532    5579 scope.go:122] "RemoveContainer" containerID="c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"
Oct 30 22:07:48.173839 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:07:48.173818    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b\": container with ID starting with c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b not found: ID does not exist" containerID="c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"
Oct 30 22:07:48.173908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.173850    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b"} err="failed to get container status \"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b\": rpc error: code = NotFound desc = could not find container \"c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b\": container with ID starting with c292b233bf7bf88caf717cbe3315ec79236579a1b24b4d98d39a162c6d9eb14b not found: ID does not exist"
Oct 30 22:07:48.366293 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.366260    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:48.411834 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:48.411801    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-50ff7514-openshift-default-679cf6446f-5r2fr"]
Oct 30 22:07:49.147411 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:49.147373    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af940721-d1d2-461d-8894-faaea2046906" path="/var/lib/kubelet/pods/af940721-d1d2-461d-8894-faaea2046906/volumes"
Oct 30 22:07:52.103219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:52.103189    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:07:59.078114 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.078076    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:07:59.078990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.078968    5579 cpu_manager.go:414] "containerMap: removing container" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy"
Oct 30 22:07:59.078990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.078989    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy"
Oct 30 22:07:59.079162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.079012    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy"
Oct 30 22:07:59.079162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.079019    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy"
Oct 30 22:07:59.079260 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.079209    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="af940721-d1d2-461d-8894-faaea2046906" containerName="istio-proxy"
Oct 30 22:07:59.079260 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.079224    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a08d2d22-9ce9-4bdf-a701-cbfd6ff12902" containerName="istio-proxy"
Oct 30 22:07:59.087586 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.087564    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.187583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.187543    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-13297892-serving-cert\""
Oct 30 22:07:59.191542 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.191515    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:07:59.221829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.221790    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8bq\" (UniqueName: \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.222037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.221962    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.222130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.222111    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.222235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.222219    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.323316 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.323281    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.323521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.323442    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8bq\" (UniqueName: \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.323521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.323515    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.323653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.323627    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.324511 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.324479    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.327073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.327049    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.327194 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.327049    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.380010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.379496    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8bq\" (UniqueName: \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\") pod \"maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.402483 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.402449    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:07:59.788812 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:07:59.788782    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:07:59.793850 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:07:59.793827    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c2cd70_6b7b_4690_b5e6_503fdd59c206.slice/crio-f7f2c212096f3a86a56b3e875ab3a201b730c1a7aab5b029954e9aafef2bad3c WatchSource:0}: Error finding container f7f2c212096f3a86a56b3e875ab3a201b730c1a7aab5b029954e9aafef2bad3c: Status 404 returned error can't find the container with id f7f2c212096f3a86a56b3e875ab3a201b730c1a7aab5b029954e9aafef2bad3c
Oct 30 22:08:00.303121 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:00.303082    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" event={"ID":"46c2cd70-6b7b-4690-b5e6-503fdd59c206","Type":"ContainerStarted","Data":"f7f2c212096f3a86a56b3e875ab3a201b730c1a7aab5b029954e9aafef2bad3c"}
Oct 30 22:08:01.312945 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:01.312890    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" event={"ID":"46c2cd70-6b7b-4690-b5e6-503fdd59c206","Type":"ContainerStarted","Data":"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"}
Oct 30 22:08:01.313369 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:01.313082    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:08:01.425280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:01.425226    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" podStartSLOduration=1.4793563459999999 podStartE2EDuration="2.425212707s" totalImagesPullingTime="945.856361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:01.422898282 +0000 UTC m=+1486.392744691" watchObservedRunningTime="2026-10-30 22:08:01.425212707 +0000 UTC m=+1486.395059115"
Oct 30 22:08:07.326073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:07.326042    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:08:12.930252 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:08:12.930217    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:08:16.996172 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:16.996136    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:08:17.000708 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.000687    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.050579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.050552    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-de9c059f-serving-cert\""
Oct 30 22:08:17.081148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.081107    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.081336 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.081258    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.081495 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.081473    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.081610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.081592    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlj9\" (UniqueName: \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.103072 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.103032    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:08:17.182889 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.182846    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.183110 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.183031    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlj9\" (UniqueName: \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.183222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.183197    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.183344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.183328    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.183704 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:08:17.183485    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-serving-cert: secret "maas-api-e2e-derive-de9c059f-serving-cert" not found
Oct 30 22:08:17.183704 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:08:17.183564    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls podName:7695823b-01eb-4e46-b01b-0b066ad83b1a nodeName:}" failed. No retries permitted until 2026-10-30 22:08:17.683544385 +0000 UTC m=+1502.653390797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls") pod "maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" (UID: "7695823b-01eb-4e46-b01b-0b066ad83b1a") : secret "maas-api-e2e-derive-de9c059f-serving-cert" not found
Oct 30 22:08:17.183704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.183682    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.185824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.185804    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.241409 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.241378    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlj9\" (UniqueName: \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.692044 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.692000    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.694691 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.694663    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") pod \"maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:17.916272 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:17.916214    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:18.297099 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:18.297018    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:08:18.301333 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:08:18.301304    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7695823b_01eb_4e46_b01b_0b066ad83b1a.slice/crio-7e440c27c64ea2b2871c85000f35eb17caecaf082792893b98be74cf4690a9ba WatchSource:0}: Error finding container 7e440c27c64ea2b2871c85000f35eb17caecaf082792893b98be74cf4690a9ba: Status 404 returned error can't find the container with id 7e440c27c64ea2b2871c85000f35eb17caecaf082792893b98be74cf4690a9ba
Oct 30 22:08:18.470678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:18.470641    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" event={"ID":"7695823b-01eb-4e46-b01b-0b066ad83b1a","Type":"ContainerStarted","Data":"7e440c27c64ea2b2871c85000f35eb17caecaf082792893b98be74cf4690a9ba"}
Oct 30 22:08:19.479211 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:19.479170    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" event={"ID":"7695823b-01eb-4e46-b01b-0b066ad83b1a","Type":"ContainerStarted","Data":"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"}
Oct 30 22:08:19.479657 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:19.479283    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:19.592386 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:19.592326    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" podStartSLOduration=2.6652476910000003 podStartE2EDuration="3.592312471s" totalImagesPullingTime="927.06478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:19.588489069 +0000 UTC m=+1504.558335479" watchObservedRunningTime="2026-10-30 22:08:19.592312471 +0000 UTC m=+1504.562158879"
Oct 30 22:08:25.492509 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:08:25.492479    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:08:42.931078 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:08:42.931041    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:09:12.932756 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:12.932680    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:09:15.237658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:15.237615    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:09:20.238597 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.238524    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" podUID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" containerName="payload-processing" containerID="cri-o://01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896" gracePeriod=25
Oct 30 22:09:20.526108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.526081    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:09:20.537062 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.537028    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\") pod \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") "
Oct 30 22:09:20.537230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.537164    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\" (UniqueName: \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\") pod \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\" (UID: \"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3\") "
Oct 30 22:09:20.537490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.537458    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume" pod "9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" (UID: "9cab9f88-3a09-45b7-a8e5-4d71c92b77a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:09:20.537660 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.537644    5579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-plugins-config-volume\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:20.539333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.539311    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr" pod "9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" (UID: "9cab9f88-3a09-45b7-a8e5-4d71c92b77a3"). InnerVolumeSpecName "kube-api-access-65zpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:20.639281 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.639239    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65zpr\" (UniqueName: \"kubernetes.io/projected/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3-kube-api-access-65zpr\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:20.974663 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.974626    5579 generic.go:356] "Generic (PLEG): container finished" podID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" containerID="01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896" exitCode=0
Oct 30 22:09:20.974848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.974672    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"
Oct 30 22:09:20.974848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.974714    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" event={"ID":"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3","Type":"ContainerDied","Data":"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"}
Oct 30 22:09:20.974848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.974794    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg" event={"ID":"9cab9f88-3a09-45b7-a8e5-4d71c92b77a3","Type":"ContainerDied","Data":"abeb1ec88766bbe2b0e869fe2f4db63a233bfc8cc04b8c72ba0dc8cb58bcaaf3"}
Oct 30 22:09:20.974848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.974818    5579 scope.go:122] "RemoveContainer" containerID="01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"
Oct 30 22:09:20.985614 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.985596    5579 scope.go:122] "RemoveContainer" containerID="01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"
Oct 30 22:09:20.985951 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:20.985910    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896\": container with ID starting with 01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896 not found: ID does not exist" containerID="01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"
Oct 30 22:09:20.986030 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:20.985957    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896"} err="failed to get container status \"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896\": rpc error: code = NotFound desc = could not find container \"01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896\": container with ID starting with 01c11821f47842daa7dab6399018895712efe4c343e7a9b4123c68f08c229896 not found: ID does not exist"
Oct 30 22:09:21.137219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:21.137175    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:09:21.148838 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:21.148810    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13297892-8bd7b9bb6-wskgg"]
Oct 30 22:09:23.148123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:23.148090    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" path="/var/lib/kubelet/pods/9cab9f88-3a09-45b7-a8e5-4d71c92b77a3/volumes"
Oct 30 22:09:23.541028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:23.540948    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:09:25.094922 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.094887    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:09:25.095623 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.095603    5579 cpu_manager.go:414] "containerMap: removing container" podUID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" containerName="payload-processing"
Oct 30 22:09:25.095623 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.095623    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" containerName="payload-processing"
Oct 30 22:09:25.095772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.095762    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cab9f88-3a09-45b7-a8e5-4d71c92b77a3" containerName="payload-processing"
Oct 30 22:09:25.101616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.101587    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.150319 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.150287    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w5-4d8041-serving-cert\""
Oct 30 22:09:25.201677 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.201634    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:09:25.233743 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.233701    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.233957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.233836    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9n2\" (UniqueName: \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.234023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.233959    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.234147 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.234130    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.335773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.335735    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.335975 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.335860    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9n2\" (UniqueName: \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.336024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.335983    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.336155 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.336078    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.336155 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:25.336137    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-serving-cert: secret "maas-api-e2e-shared-a-w5-4d8041-serving-cert" not found
Oct 30 22:09:25.336349 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:25.336216    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls podName:4c19bb0a-1fcd-44b3-8619-c09b8203bff4 nodeName:}" failed. No retries permitted until 2026-10-30 22:09:25.836193628 +0000 UTC m=+1570.806040035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls") pod "maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" (UID: "4c19bb0a-1fcd-44b3-8619-c09b8203bff4") : secret "maas-api-e2e-shared-a-w5-4d8041-serving-cert" not found
Oct 30 22:09:25.336730 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.336708    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.338419 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.338400    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.390288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.390257    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9n2\" (UniqueName: \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.843658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.843554    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:25.846670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:25.846639    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:26.020769 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:26.020731    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:26.424014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:26.423979    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:09:26.428428 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:09:26.428395    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c19bb0a_1fcd_44b3_8619_c09b8203bff4.slice/crio-dc80501c8ab25c24c9b7c0c7392e8aa3bdd1d41c2c96baae1612508de77eeafc WatchSource:0}: Error finding container dc80501c8ab25c24c9b7c0c7392e8aa3bdd1d41c2c96baae1612508de77eeafc: Status 404 returned error can't find the container with id dc80501c8ab25c24c9b7c0c7392e8aa3bdd1d41c2c96baae1612508de77eeafc
Oct 30 22:09:27.024890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:27.024850    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" event={"ID":"4c19bb0a-1fcd-44b3-8619-c09b8203bff4","Type":"ContainerStarted","Data":"dc80501c8ab25c24c9b7c0c7392e8aa3bdd1d41c2c96baae1612508de77eeafc"}
Oct 30 22:09:28.046294 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.046247    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" event={"ID":"4c19bb0a-1fcd-44b3-8619-c09b8203bff4","Type":"ContainerStarted","Data":"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"}
Oct 30 22:09:28.046972 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.046948    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:28.161457 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.161387    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" podStartSLOduration=2.339467225 podStartE2EDuration="3.161365486s" totalImagesPullingTime="821.898261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:28.156310923 +0000 UTC m=+1573.126157332" watchObservedRunningTime="2026-10-30 22:09:28.161365486 +0000 UTC m=+1573.131211897"
Oct 30 22:09:28.541863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.541819    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" podUID="5d255234-2e95-444c-850f-d4bdb12fc44a" containerName="payload-pre-processing" containerID="cri-o://c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d" gracePeriod=25
Oct 30 22:09:28.822202 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.822178    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:09:28.891563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.891523    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\") pod \"5d255234-2e95-444c-850f-d4bdb12fc44a\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") "
Oct 30 22:09:28.891769 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.891592    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\" (UniqueName: \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\") pod \"5d255234-2e95-444c-850f-d4bdb12fc44a\" (UID: \"5d255234-2e95-444c-850f-d4bdb12fc44a\") "
Oct 30 22:09:28.892129 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.892102    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume" pod "5d255234-2e95-444c-850f-d4bdb12fc44a" (UID: "5d255234-2e95-444c-850f-d4bdb12fc44a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:09:28.893707 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.893683    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792" pod "5d255234-2e95-444c-850f-d4bdb12fc44a" (UID: "5d255234-2e95-444c-850f-d4bdb12fc44a"). InnerVolumeSpecName "kube-api-access-lj792". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:28.994018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.993987    5579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d255234-2e95-444c-850f-d4bdb12fc44a-plugins-config-volume\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:28.994018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:28.994013    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj792\" (UniqueName: \"kubernetes.io/projected/5d255234-2e95-444c-850f-d4bdb12fc44a-kube-api-access-lj792\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:29.061824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.061729    5579 generic.go:356] "Generic (PLEG): container finished" podID="5d255234-2e95-444c-850f-d4bdb12fc44a" containerID="c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d" exitCode=0
Oct 30 22:09:29.061824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.061798    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"
Oct 30 22:09:29.061824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.061813    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" event={"ID":"5d255234-2e95-444c-850f-d4bdb12fc44a","Type":"ContainerDied","Data":"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"}
Oct 30 22:09:29.062422 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.061866    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4" event={"ID":"5d255234-2e95-444c-850f-d4bdb12fc44a","Type":"ContainerDied","Data":"18e55d009e1ccab76161fd33194205a227636ec10930f8e42eaa01737cc8f798"}
Oct 30 22:09:29.062422 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.061892    5579 scope.go:122] "RemoveContainer" containerID="c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"
Oct 30 22:09:29.077077 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.077036    5579 scope.go:122] "RemoveContainer" containerID="c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"
Oct 30 22:09:29.077761 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:29.077739    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d\": container with ID starting with c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d not found: ID does not exist" containerID="c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"
Oct 30 22:09:29.077866 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.077771    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d"} err="failed to get container status \"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d\": rpc error: code = NotFound desc = could not find container \"c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d\": container with ID starting with c10d116a510bce49d1ca8b598142d2e47b0f5c48c0de347cda08fd39ecbc183d not found: ID does not exist"
Oct 30 22:09:29.217809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.217775    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:09:29.221562 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:29.221535    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-de9c059f-6f68cc6dff-fdfx4"]
Oct 30 22:09:31.148131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:31.148098    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d255234-2e95-444c-850f-d4bdb12fc44a" path="/var/lib/kubelet/pods/5d255234-2e95-444c-850f-d4bdb12fc44a/volumes"
Oct 30 22:09:34.069796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:34.069766    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:09:38.301123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.301086    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:09:38.301624 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.301295    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" podUID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" containerName="maas-api" containerID="cri-o://08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720" gracePeriod=30
Oct 30 22:09:38.664648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.664620    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:09:38.739151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.739119    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\") pod \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") "
Oct 30 22:09:38.739377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.739345    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\" (UniqueName: \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\") pod \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") "
Oct 30 22:09:38.739538 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.739392    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\") pod \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") "
Oct 30 22:09:38.739538 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.739478    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\") pod \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\" (UID: \"46c2cd70-6b7b-4690-b5e6-503fdd59c206\") "
Oct 30 22:09:38.742455 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.742421    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls" pod "46c2cd70-6b7b-4690-b5e6-503fdd59c206" (UID: "46c2cd70-6b7b-4690-b5e6-503fdd59c206"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:38.742599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.742493    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq" pod "46c2cd70-6b7b-4690-b5e6-503fdd59c206" (UID: "46c2cd70-6b7b-4690-b5e6-503fdd59c206"). InnerVolumeSpecName "kube-api-access-hc8bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:38.745118 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.745081    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca" pod "46c2cd70-6b7b-4690-b5e6-503fdd59c206" (UID: "46c2cd70-6b7b-4690-b5e6-503fdd59c206"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:09:38.747295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.747272    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs" pod "46c2cd70-6b7b-4690-b5e6-503fdd59c206" (UID: "46c2cd70-6b7b-4690-b5e6-503fdd59c206"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:38.841380 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.841336    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc8bq\" (UniqueName: \"kubernetes.io/projected/46c2cd70-6b7b-4690-b5e6-503fdd59c206-kube-api-access-hc8bq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:38.841380 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.841374    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46c2cd70-6b7b-4690-b5e6-503fdd59c206-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:38.841589 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.841392    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:38.841589 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:38.841406    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c2cd70-6b7b-4690-b5e6-503fdd59c206-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:39.139715 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.139679    5579 generic.go:356] "Generic (PLEG): container finished" podID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" containerID="08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720" exitCode=0
Oct 30 22:09:39.139908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.139782    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"
Oct 30 22:09:39.147061 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.147031    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" event={"ID":"46c2cd70-6b7b-4690-b5e6-503fdd59c206","Type":"ContainerDied","Data":"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"}
Oct 30 22:09:39.147183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.147080    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt" event={"ID":"46c2cd70-6b7b-4690-b5e6-503fdd59c206","Type":"ContainerDied","Data":"f7f2c212096f3a86a56b3e875ab3a201b730c1a7aab5b029954e9aafef2bad3c"}
Oct 30 22:09:39.147183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.147103    5579 scope.go:122] "RemoveContainer" containerID="08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"
Oct 30 22:09:39.157759 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.157738    5579 scope.go:122] "RemoveContainer" containerID="08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"
Oct 30 22:09:39.158047 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:39.158025    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720\": container with ID starting with 08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720 not found: ID does not exist" containerID="08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"
Oct 30 22:09:39.158099 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.158058    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720"} err="failed to get container status \"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720\": rpc error: code = NotFound desc = could not find container \"08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720\": container with ID starting with 08dbf059a54f1fb5880f7c97d11fe6892f8232f07eaf74910ef1d0e5e49e2720 not found: ID does not exist"
Oct 30 22:09:39.295433 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.295396    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:09:39.301706 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:39.301674    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13297892-b985b8f5f-mqgwt"]
Oct 30 22:09:41.148295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:41.148262    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" path="/var/lib/kubelet/pods/46c2cd70-6b7b-4690-b5e6-503fdd59c206/volumes"
Oct 30 22:09:42.934116 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:42.934072    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:09:53.840417 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:53.840380    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:09:53.841038 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:53.840625    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" podUID="7695823b-01eb-4e46-b01b-0b066ad83b1a" containerName="maas-api" containerID="cri-o://9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e" gracePeriod=30
Oct 30 22:09:54.146639 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.145949    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:09:54.201269 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201241    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") pod \"7695823b-01eb-4e46-b01b-0b066ad83b1a\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") "
Oct 30 22:09:54.201470 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201374    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\") pod \"7695823b-01eb-4e46-b01b-0b066ad83b1a\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") "
Oct 30 22:09:54.201470 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201441    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\") pod \"7695823b-01eb-4e46-b01b-0b066ad83b1a\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") "
Oct 30 22:09:54.201598 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201537    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\" (UniqueName: \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\") pod \"7695823b-01eb-4e46-b01b-0b066ad83b1a\" (UID: \"7695823b-01eb-4e46-b01b-0b066ad83b1a\") "
Oct 30 22:09:54.201839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201810    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca" pod "7695823b-01eb-4e46-b01b-0b066ad83b1a" (UID: "7695823b-01eb-4e46-b01b-0b066ad83b1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:09:54.202016 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.201995    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7695823b-01eb-4e46-b01b-0b066ad83b1a-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:54.203941 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.203889    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls" pod "7695823b-01eb-4e46-b01b-0b066ad83b1a" (UID: "7695823b-01eb-4e46-b01b-0b066ad83b1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:54.204354 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.204325    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs" pod "7695823b-01eb-4e46-b01b-0b066ad83b1a" (UID: "7695823b-01eb-4e46-b01b-0b066ad83b1a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:09:54.204451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.204382    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9" pod "7695823b-01eb-4e46-b01b-0b066ad83b1a" (UID: "7695823b-01eb-4e46-b01b-0b066ad83b1a"). InnerVolumeSpecName "kube-api-access-nwlj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:09:54.294754 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.294703    5579 generic.go:356] "Generic (PLEG): container finished" podID="7695823b-01eb-4e46-b01b-0b066ad83b1a" containerID="9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e" exitCode=0
Oct 30 22:09:54.295010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.294957    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" event={"ID":"7695823b-01eb-4e46-b01b-0b066ad83b1a","Type":"ContainerDied","Data":"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"}
Oct 30 22:09:54.295101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.295009    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s" event={"ID":"7695823b-01eb-4e46-b01b-0b066ad83b1a","Type":"ContainerDied","Data":"7e440c27c64ea2b2871c85000f35eb17caecaf082792893b98be74cf4690a9ba"}
Oct 30 22:09:54.295101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.295038    5579 scope.go:122] "RemoveContainer" containerID="9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"
Oct 30 22:09:54.295208 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.295195    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"
Oct 30 22:09:54.305569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.305532    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:54.305569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.305571    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwlj9\" (UniqueName: \"kubernetes.io/projected/7695823b-01eb-4e46-b01b-0b066ad83b1a-kube-api-access-nwlj9\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:54.305811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.305587    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7695823b-01eb-4e46-b01b-0b066ad83b1a-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:09:54.333694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.333642    5579 scope.go:122] "RemoveContainer" containerID="9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"
Oct 30 22:09:54.334180 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:09:54.334150    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e\": container with ID starting with 9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e not found: ID does not exist" containerID="9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"
Oct 30 22:09:54.334293 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.334195    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e"} err="failed to get container status \"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e\": rpc error: code = NotFound desc = could not find container \"9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e\": container with ID starting with 9eb56cfcd901fa329797b7494d4afbe054d16ab936faeea94efee816159d3a5e not found: ID does not exist"
Oct 30 22:09:54.462211 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.462179    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:09:54.468415 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:54.468384    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-de9c059f-7d46cdf7c5-tbz2s"]
Oct 30 22:09:55.147311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:09:55.147279    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7695823b-01eb-4e46-b01b-0b066ad83b1a" path="/var/lib/kubelet/pods/7695823b-01eb-4e46-b01b-0b066ad83b1a/volumes"
Oct 30 22:10:04.917282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.917245    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:10:04.918267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918237    5579 cpu_manager.go:414] "containerMap: removing container" podUID="7695823b-01eb-4e46-b01b-0b066ad83b1a" containerName="maas-api"
Oct 30 22:10:04.918456 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918431    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7695823b-01eb-4e46-b01b-0b066ad83b1a" containerName="maas-api"
Oct 30 22:10:04.918565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918465    5579 cpu_manager.go:414] "containerMap: removing container" podUID="5d255234-2e95-444c-850f-d4bdb12fc44a" containerName="payload-pre-processing"
Oct 30 22:10:04.918565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918475    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d255234-2e95-444c-850f-d4bdb12fc44a" containerName="payload-pre-processing"
Oct 30 22:10:04.918565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918487    5579 cpu_manager.go:414] "containerMap: removing container" podUID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" containerName="maas-api"
Oct 30 22:10:04.918565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918495    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" containerName="maas-api"
Oct 30 22:10:04.918724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918666    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d255234-2e95-444c-850f-d4bdb12fc44a" containerName="payload-pre-processing"
Oct 30 22:10:04.918724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918678    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="46c2cd70-6b7b-4690-b5e6-503fdd59c206" containerName="maas-api"
Oct 30 22:10:04.918724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.918689    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="7695823b-01eb-4e46-b01b-0b066ad83b1a" containerName="maas-api"
Oct 30 22:10:04.922535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.922516    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:04.974571 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:04.974540    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7d434591-serving-cert\""
Oct 30 22:10:05.024890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.024849    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:10:05.078232 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.078192    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fss7n\" (UniqueName: \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.078458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.078252    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.078645 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.078623    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.078731 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.078711    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.185959 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.185842    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.186161 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.186100    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fss7n\" (UniqueName: \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.187096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.186160    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.187096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.186443    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.187096 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:05.186694    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-serving-cert: secret "maas-api-e2e-mt-7d434591-serving-cert" not found
Oct 30 22:10:05.187096 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:05.186762    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls podName:53901d6e-dc2c-4f6b-bc31-256d82dcb209 nodeName:}" failed. No retries permitted until 2026-10-30 22:10:05.686742372 +0000 UTC m=+1610.656588781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls") pod "maas-api-e2e-mt-7d434591-f7ddc6f-878s5" (UID: "53901d6e-dc2c-4f6b-bc31-256d82dcb209") : secret "maas-api-e2e-mt-7d434591-serving-cert" not found
Oct 30 22:10:05.188151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.188128    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.190303 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.190281    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.244204 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.243206    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fss7n\" (UniqueName: \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.694253 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.694213    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.696893 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.696858    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") pod \"maas-api-e2e-mt-7d434591-f7ddc6f-878s5\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:05.837166 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:05.837124    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:06.228645 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:06.228613    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:10:06.232637 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:10:06.232603    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53901d6e_dc2c_4f6b_bc31_256d82dcb209.slice/crio-e07e7bfa44fa230a0af08afe008957d0acbb0831a4d2279a75ef5183f0934a49 WatchSource:0}: Error finding container e07e7bfa44fa230a0af08afe008957d0acbb0831a4d2279a75ef5183f0934a49: Status 404 returned error can't find the container with id e07e7bfa44fa230a0af08afe008957d0acbb0831a4d2279a75ef5183f0934a49
Oct 30 22:10:06.234421 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:06.234402    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:10:06.396135 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:06.396101    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" event={"ID":"53901d6e-dc2c-4f6b-bc31-256d82dcb209","Type":"ContainerStarted","Data":"e07e7bfa44fa230a0af08afe008957d0acbb0831a4d2279a75ef5183f0934a49"}
Oct 30 22:10:07.407439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:07.407384    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" event={"ID":"53901d6e-dc2c-4f6b-bc31-256d82dcb209","Type":"ContainerStarted","Data":"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"}
Oct 30 22:10:07.407852 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:07.407486    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:07.519221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:07.519167    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" podStartSLOduration=2.637726593 podStartE2EDuration="3.519152224s" totalImagesPullingTime="881.425631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:07.517580644 +0000 UTC m=+1612.487427053" watchObservedRunningTime="2026-10-30 22:10:07.519152224 +0000 UTC m=+1612.488998633"
Oct 30 22:10:12.145462 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.145417    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:10:12.145886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.145630    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy" containerID="cri-o://163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c" gracePeriod=30
Oct 30 22:10:12.191738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.191692    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:10:12.191986 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.191921    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy" containerID="cri-o://76ea40e5bd3e0bcd2c90b8257b7359461158fd9b0638234531e54159f466355d" gracePeriod=30
Oct 30 22:10:12.238256 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.238222    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:10:12.238450 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:12.238419    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy" containerID="cri-o://9a6170098944782b2bcec461535c6f4aecf97558f9a57d1c37e174d7daf90152" gracePeriod=30
Oct 30 22:10:12.930182 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:12.930143    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:10:13.423467 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:13.423431    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:10:17.493984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.493918    5579 generic.go:356] "Generic (PLEG): container finished" podID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerID="76ea40e5bd3e0bcd2c90b8257b7359461158fd9b0638234531e54159f466355d" exitCode=0
Oct 30 22:10:17.494537 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.494010    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" event={"ID":"9437bc08-136f-40fb-84b2-25348c2b05cc","Type":"ContainerDied","Data":"76ea40e5bd3e0bcd2c90b8257b7359461158fd9b0638234531e54159f466355d"}
Oct 30 22:10:17.496271 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.496247    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:10:17.496974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.496949    5579 generic.go:356] "Generic (PLEG): container finished" podID="2810689e-c0e1-479f-96ad-d014310d709a" containerID="163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c" exitCode=0
Oct 30 22:10:17.497973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.497940    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" event={"ID":"2810689e-c0e1-479f-96ad-d014310d709a","Type":"ContainerDied","Data":"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"}
Oct 30 22:10:17.498076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.498003    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj" event={"ID":"2810689e-c0e1-479f-96ad-d014310d709a","Type":"ContainerDied","Data":"b8f00558c7b9eab2bacbafa53214b0be4e747ee464c440a33136cdbbda4b244c"}
Oct 30 22:10:17.498076 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.498032    5579 scope.go:122] "RemoveContainer" containerID="163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"
Oct 30 22:10:17.499874 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.499778    5579 generic.go:356] "Generic (PLEG): container finished" podID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerID="9a6170098944782b2bcec461535c6f4aecf97558f9a57d1c37e174d7daf90152" exitCode=0
Oct 30 22:10:17.499957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.499916    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" event={"ID":"72fd0ab4-0670-43c2-854b-8d719b086aec","Type":"ContainerDied","Data":"9a6170098944782b2bcec461535c6f4aecf97558f9a57d1c37e174d7daf90152"}
Oct 30 22:10:17.518769 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.518650    5579 scope.go:122] "RemoveContainer" containerID="163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"
Oct 30 22:10:17.519213 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:17.519183    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c\": container with ID starting with 163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c not found: ID does not exist" containerID="163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"
Oct 30 22:10:17.519326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.519230    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c"} err="failed to get container status \"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c\": rpc error: code = NotFound desc = could not find container \"163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c\": container with ID starting with 163ac3b4f3715c0a51fb6ab24477b414d72973e13b34292a407449654f77b21c not found: ID does not exist"
Oct 30 22:10:17.574876 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.574842    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:10:17.610754 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.610729    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:10:17.618990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.618961    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619137 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619017    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619199 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619138    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619221    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619262    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619290    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.619414 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619360    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619414 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619404    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619440    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619502    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.619630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619522    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.619630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619596    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\") pod \"2810689e-c0e1-479f-96ad-d014310d709a\" (UID: \"2810689e-c0e1-479f-96ad-d014310d709a\") "
Oct 30 22:10:17.619854 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.619830    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:17.620091 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620066    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.620402 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620379    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.620490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620408    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.620490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620423    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2810689e-c0e1-479f-96ad-d014310d709a-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.620490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620437    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.620490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.620450    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.621401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.621376    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:10:17.621503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.621464    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.621684 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.621661    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "kube-api-access-9dxnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.621831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.621800    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token" pod "2810689e-c0e1-479f-96ad-d014310d709a" (UID: "2810689e-c0e1-479f-96ad-d014310d709a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721184    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721270    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721313    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721341    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721371    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721407    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721461    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721497    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721528    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721583    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721674    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721751    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721864    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721870    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.721976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.721898    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.722879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.722157    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.722879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.722694    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.722879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.722751    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.723045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.722999    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:17.723273 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723248    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.723377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723282    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.723377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723332    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.723479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723390    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.723479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723444    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\") pod \"72fd0ab4-0670-43c2-854b-8d719b086aec\" (UID: \"72fd0ab4-0670-43c2-854b-8d719b086aec\") "
Oct 30 22:10:17.723583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723515    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\") pod \"9437bc08-136f-40fb-84b2-25348c2b05cc\" (UID: \"9437bc08-136f-40fb-84b2-25348c2b05cc\") "
Oct 30 22:10:17.724193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723620    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:10:17.724193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.723889    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724259    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724283    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dxnc\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-kube-api-access-9dxnc\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724299    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437bc08-136f-40fb-84b2-25348c2b05cc-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724313    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2810689e-c0e1-479f-96ad-d014310d709a-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724326    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724339    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724352    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724366    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2810689e-c0e1-479f-96ad-d014310d709a-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724382    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72fd0ab4-0670-43c2-854b-8d719b086aec-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724399    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724413    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724428    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2810689e-c0e1-479f-96ad-d014310d709a-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.724841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.724442    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.725251 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.725214    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.725633 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.725607    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.726622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.726592    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:10:17.726843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.726820    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "kube-api-access-9tnbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.726998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.726857    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.726998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.726978    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:10:17.727600 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.727559    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.727877 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.727851    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p" pod "72fd0ab4-0670-43c2-854b-8d719b086aec" (UID: "72fd0ab4-0670-43c2-854b-8d719b086aec"). InnerVolumeSpecName "kube-api-access-jg97p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:10:17.728413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.728393    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy" pod "9437bc08-136f-40fb-84b2-25348c2b05cc" (UID: "9437bc08-136f-40fb-84b2-25348c2b05cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:10:17.824340 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.824271    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:10:17.825185 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825159    5579 cpu_manager.go:414] "containerMap: removing container" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy"
Oct 30 22:10:17.825185 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825184    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy"
Oct 30 22:10:17.825343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825228    5579 cpu_manager.go:414] "containerMap: removing container" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy"
Oct 30 22:10:17.825343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825235    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy"
Oct 30 22:10:17.825343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825278    5579 cpu_manager.go:414] "containerMap: removing container" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy"
Oct 30 22:10:17.825343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825285    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy"
Oct 30 22:10:17.825518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825425    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" containerName="istio-proxy"
Oct 30 22:10:17.825518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825440    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" containerName="istio-proxy"
Oct 30 22:10:17.825518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.825455    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="2810689e-c0e1-479f-96ad-d014310d709a" containerName="istio-proxy"
Oct 30 22:10:17.827260 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.826515    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.828886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828861    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828889    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828903    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg97p\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-kube-api-access-jg97p\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828917    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828945    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828959    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828972    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72fd0ab4-0670-43c2-854b-8d719b086aec-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.829078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.828986    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tnbb\" (UniqueName: \"kubernetes.io/projected/9437bc08-136f-40fb-84b2-25348c2b05cc-kube-api-access-9tnbb\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:10:17.837236 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.837202    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:17.889600 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.889569    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 22:10:17.889849 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.889830    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 22:10:17.889988 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.889841    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 22:10:17.890130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.890112    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dwlzg\""
Oct 30 22:10:17.931884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:17.931845    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:10:18.031693 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.031652    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032112 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.031789    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032112 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.031840    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032112 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.031890    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032112 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.031955    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6v8\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032350 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.032128    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.032350 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.032158    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133615 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133579    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133647    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6v8\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133774    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133978 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133795    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133978 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133821    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.133978 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133904    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.134170 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.133979    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.134459 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.134432    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.136376 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.136345    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.136486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.136348    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.136486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.136385    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.136486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.136403    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.189223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.189181    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.189665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.189639    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6v8\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-q46lx\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.455240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.455149    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:18.527973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.527099    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"
Oct 30 22:10:18.529317 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.529284    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m" event={"ID":"9437bc08-136f-40fb-84b2-25348c2b05cc","Type":"ContainerDied","Data":"43d910d854a17b808972fdf68609cee8d2adc1d5fed530df282be212148e0373"}
Oct 30 22:10:18.529475 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.529356    5579 scope.go:122] "RemoveContainer" containerID="76ea40e5bd3e0bcd2c90b8257b7359461158fd9b0638234531e54159f466355d"
Oct 30 22:10:18.536591 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.536567    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"
Oct 30 22:10:18.545413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.545379    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6" event={"ID":"72fd0ab4-0670-43c2-854b-8d719b086aec","Type":"ContainerDied","Data":"bcbba7bd4dd7158ec5cddee8e1a94cc3b73706b2a62f452abd2a7a80b3c91947"}
Oct 30 22:10:18.545524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.545504    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"
Oct 30 22:10:18.567267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.567244    5579 scope.go:122] "RemoveContainer" containerID="9a6170098944782b2bcec461535c6f4aecf97558f9a57d1c37e174d7daf90152"
Oct 30 22:10:18.686686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.686655    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:10:18.690334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.690308    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-sqrb6"]
Oct 30 22:10:18.791923 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.791841    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:10:18.797626 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.797597    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-cdb2m"]
Oct 30 22:10:18.910229 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.910197    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:10:18.916522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.916495    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-gfnlj"]
Oct 30 22:10:18.959760 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:18.959718    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:10:18.964515 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:10:18.964484    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d6f0e5_d39f_46bb_83bf_9c95178988d8.slice/crio-f48a8faf5a2b2419e652bc01dee55d0bd522acbe06582dd8a8eef09f683e528e WatchSource:0}: Error finding container f48a8faf5a2b2419e652bc01dee55d0bd522acbe06582dd8a8eef09f683e528e: Status 404 returned error can't find the container with id f48a8faf5a2b2419e652bc01dee55d0bd522acbe06582dd8a8eef09f683e528e
Oct 30 22:10:19.148159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:19.148130    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2810689e-c0e1-479f-96ad-d014310d709a" path="/var/lib/kubelet/pods/2810689e-c0e1-479f-96ad-d014310d709a/volumes"
Oct 30 22:10:19.148658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:19.148641    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72fd0ab4-0670-43c2-854b-8d719b086aec" path="/var/lib/kubelet/pods/72fd0ab4-0670-43c2-854b-8d719b086aec/volumes"
Oct 30 22:10:19.149102 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:19.149089    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9437bc08-136f-40fb-84b2-25348c2b05cc" path="/var/lib/kubelet/pods/9437bc08-136f-40fb-84b2-25348c2b05cc/volumes"
Oct 30 22:10:19.553106 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:19.553018    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" event={"ID":"c5d6f0e5-d39f-46bb-83bf-9c95178988d8","Type":"ContainerStarted","Data":"f48a8faf5a2b2419e652bc01dee55d0bd522acbe06582dd8a8eef09f683e528e"}
Oct 30 22:10:23.215307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:23.215249    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:10:23.215656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:23.215362    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:10:23.590460 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:23.590358    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" event={"ID":"c5d6f0e5-d39f-46bb-83bf-9c95178988d8","Type":"ContainerStarted","Data":"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"}
Oct 30 22:10:23.590652 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:23.590499    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:23.813457 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:23.813404    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" podStartSLOduration=2.56650681 podStartE2EDuration="6.813390208s" totalImagesPullingTime="4.246883398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:23.763555682 +0000 UTC m=+1628.733402091" watchObservedRunningTime="2026-10-30 22:10:23.813390208 +0000 UTC m=+1628.783236617"
Oct 30 22:10:24.610000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:24.609964    5579 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-q46lx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:10:24.610578 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:24.610545    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:10:27.608449 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:27.608363    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:10:33.458268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.458230    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:10:33.462994 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.462972    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.511868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.511843    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4215ed-serving-cert\""
Oct 30 22:10:33.562025 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.561991    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:10:33.576161 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.576124    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.576333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.576173    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.576424 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.576398    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hsj6\" (UniqueName: \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.576484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.576456    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.678321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.678291    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.678524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.678334    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.678524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.678416    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hsj6\" (UniqueName: \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.678524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.678450    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.678524 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:33.678514    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-serving-cert: secret "maas-api-e2e-shared-a-w2-4215ed-serving-cert" not found
Oct 30 22:10:33.678779 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:33.678595    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls podName:3f914e10-140b-49db-a4f6-d1bfbf1c0768 nodeName:}" failed. No retries permitted until 2026-10-30 22:10:34.178573323 +0000 UTC m=+1639.148419710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" (UID: "3f914e10-140b-49db-a4f6-d1bfbf1c0768") : secret "maas-api-e2e-shared-a-w2-4215ed-serving-cert" not found
Oct 30 22:10:33.679151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.679129    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.680983 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.680958    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:33.747729 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:33.747633    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hsj6\" (UniqueName: \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:34.198826 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:34.198778    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:34.204376 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:34.204345    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:34.377236 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:34.377200    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:34.784019 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:34.783938    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:10:34.789403 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:10:34.789368    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f914e10_140b_49db_a4f6_d1bfbf1c0768.slice/crio-106a2a4b17c3e50d1bf688070d8d0711da050f1d76d9d209bc17d0d858e2da0c WatchSource:0}: Error finding container 106a2a4b17c3e50d1bf688070d8d0711da050f1d76d9d209bc17d0d858e2da0c: Status 404 returned error can't find the container with id 106a2a4b17c3e50d1bf688070d8d0711da050f1d76d9d209bc17d0d858e2da0c
Oct 30 22:10:35.688460 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:35.688425    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" event={"ID":"3f914e10-140b-49db-a4f6-d1bfbf1c0768","Type":"ContainerStarted","Data":"106a2a4b17c3e50d1bf688070d8d0711da050f1d76d9d209bc17d0d858e2da0c"}
Oct 30 22:10:36.696530 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:36.696496    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" event={"ID":"3f914e10-140b-49db-a4f6-d1bfbf1c0768","Type":"ContainerStarted","Data":"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"}
Oct 30 22:10:36.696914 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:36.696571    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:36.810535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:36.810483    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" podStartSLOduration=2.909201607 podStartE2EDuration="3.810470202s" totalImagesPullingTime="901.268595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:36.810221585 +0000 UTC m=+1641.780067994" watchObservedRunningTime="2026-10-30 22:10:36.810470202 +0000 UTC m=+1641.780316656"
Oct 30 22:10:42.709323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:42.709291    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:10:42.931513 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:10:42.931474    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:10:57.192128 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.192095    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:10:57.192594 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.192302    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy" containerID="cri-o://62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8" gracePeriod=30
Oct 30 22:10:57.361845 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.361801    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 22:10:57.363369 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.363331    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" containerID="cri-o://682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873" gracePeriod=30
Oct 30 22:10:57.370353 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.370324    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:10:57.370610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.370565    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy" containerID="cri-o://f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f" gracePeriod=30
Oct 30 22:10:57.593073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.592977    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:10:57.601436 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.601408    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.650169 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.650139    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-446040-serving-cert\""
Oct 30 22:10:57.661292 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.661259    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:10:57.749439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.749406    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.749626 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.749571    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6sxt\" (UniqueName: \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.749741 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.749727    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.749788 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.749774    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.850994 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.850880    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6sxt\" (UniqueName: \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.851178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.851042    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.851178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.851089    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.851178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.851149    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.851850 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.851824    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.854079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.854059    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.854274 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.854252    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.906557 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.906522    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6sxt\" (UniqueName: \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\") pod \"maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:57.915440 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:57.915412    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:10:58.301223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:58.301186    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:10:58.314166 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:10:58.314128    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a85b8a6_8310_4bb4_9bda_2248ffae2011.slice/crio-88b0de10ab8f4d24feae34df9bafb3c6dc8581eb6db80999bf3a3ef38e2c6759 WatchSource:0}: Error finding container 88b0de10ab8f4d24feae34df9bafb3c6dc8581eb6db80999bf3a3ef38e2c6759: Status 404 returned error can't find the container with id 88b0de10ab8f4d24feae34df9bafb3c6dc8581eb6db80999bf3a3ef38e2c6759
Oct 30 22:10:58.869331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:58.869297    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" event={"ID":"4a85b8a6-8310-4bb4-9bda-2248ffae2011","Type":"ContainerStarted","Data":"88b0de10ab8f4d24feae34df9bafb3c6dc8581eb6db80999bf3a3ef38e2c6759"}
Oct 30 22:10:59.893032 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:59.892973    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" event={"ID":"4a85b8a6-8310-4bb4-9bda-2248ffae2011","Type":"ContainerStarted","Data":"da050ad59615d99e4aa6968388b20814bac98c7b87f3cd6fa394132ffaa5c7b0"}
Oct 30 22:10:59.893576 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:10:59.893245    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:11:00.008998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:00.008918    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" podStartSLOduration=2.184444357 podStartE2EDuration="3.008897819s" totalImagesPullingTime="824.453462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:00.003612232 +0000 UTC m=+1664.973458642" watchObservedRunningTime="2026-10-30 22:11:00.008897819 +0000 UTC m=+1664.978744222"
Oct 30 22:11:00.225232 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:00.225152    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:11:00.225232 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:00.225207    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:11:02.532991 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.531763    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548345    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548473    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548548    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548621    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548672    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548715    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548744    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548788    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.549901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.548844    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\") pod \"a7151163-353a-462d-90a3-e1e90affb2a7\" (UID: \"a7151163-353a-462d-90a3-e1e90affb2a7\") "
Oct 30 22:11:02.551495 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.551427    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.553445 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.553408    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.554413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.554383    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:02.555253 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.555220    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:02.555690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.555501    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.555690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.555563    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.555690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.555640    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.556596 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.556557    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.557720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.557693    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr" pod "a7151163-353a-462d-90a3-e1e90affb2a7" (UID: "a7151163-353a-462d-90a3-e1e90affb2a7"). InnerVolumeSpecName "kube-api-access-n8tmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.655814 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.655323    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7151163-353a-462d-90a3-e1e90affb2a7-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.655369    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8tmr\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-kube-api-access-n8tmr\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659589    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659605    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659618    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659631    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659644    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7151163-353a-462d-90a3-e1e90affb2a7-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659656    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7151163-353a-462d-90a3-e1e90affb2a7-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.660008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.659669    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7151163-353a-462d-90a3-e1e90affb2a7-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.708187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.705091    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 22:11:02.742732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.742705    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:11:02.760357 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760315    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.760357 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760356    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.760612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760377    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.760612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760526    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.760612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760597    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760647    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760667    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760683    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760696    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760725    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.760777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760762    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760817    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760871    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760866    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760898    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760919    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760958    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.760998    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.761108 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.761052    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.761507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.761128    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.761507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.761159    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\") pod \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\" (UID: \"086eb7c9-fe65-40f2-8aa1-b9bf829b575b\") "
Oct 30 22:11:02.761507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.761167    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.761507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.761288    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\") pod \"0abe9df3-5680-446a-b468-ac26aea29e91\" (UID: \"0abe9df3-5680-446a-b468-ac26aea29e91\") "
Oct 30 22:11:02.762379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.762023    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.762379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.762049    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.762379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.762064    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.762379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.762079    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.762379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.762092    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.763342 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.763052    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.763342 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.763239    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:02.763517 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.763378    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.763663 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.763635    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.763772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.763751    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:02.765484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.765408    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.766070 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766039    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.766702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766678    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:02.766787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766705    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.766787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766725    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "kube-api-access-spcnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.766787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766746    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:02.766787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.766750    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv" pod "086eb7c9-fe65-40f2-8aa1-b9bf829b575b" (UID: "086eb7c9-fe65-40f2-8aa1-b9bf829b575b"). InnerVolumeSpecName "kube-api-access-tbfkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:02.767921 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.767901    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy" pod "0abe9df3-5680-446a-b468-ac26aea29e91" (UID: "0abe9df3-5680-446a-b468-ac26aea29e91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863530    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spcnf\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-kube-api-access-spcnf\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863568    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863591    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863606    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863620    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863636    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abe9df3-5680-446a-b468-ac26aea29e91-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863649    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863663    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abe9df3-5680-446a-b468-ac26aea29e91-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863676    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abe9df3-5680-446a-b468-ac26aea29e91-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863690    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863704    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863726    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbfkv\" (UniqueName: \"kubernetes.io/projected/086eb7c9-fe65-40f2-8aa1-b9bf829b575b-kube-api-access-tbfkv\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.864985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.863740    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abe9df3-5680-446a-b468-ac26aea29e91-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:11:02.917147 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.917107    5579 generic.go:356] "Generic (PLEG): container finished" podID="a7151163-353a-462d-90a3-e1e90affb2a7" containerID="62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8" exitCode=0
Oct 30 22:11:02.917343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.917174    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"
Oct 30 22:11:02.917343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.917214    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" event={"ID":"a7151163-353a-462d-90a3-e1e90affb2a7","Type":"ContainerDied","Data":"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"}
Oct 30 22:11:02.917343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.917328    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2" event={"ID":"a7151163-353a-462d-90a3-e1e90affb2a7","Type":"ContainerDied","Data":"323f10f1898151f9fbe512ad16b6ac0a71af6342a06fb67d012d77176cc61351"}
Oct 30 22:11:02.917474 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.917363    5579 scope.go:122] "RemoveContainer" containerID="62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"
Oct 30 22:11:02.919120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.919096    5579 generic.go:356] "Generic (PLEG): container finished" podID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerID="f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f" exitCode=0
Oct 30 22:11:02.919697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.919339    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"
Oct 30 22:11:02.920012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.919313    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" event={"ID":"086eb7c9-fe65-40f2-8aa1-b9bf829b575b","Type":"ContainerDied","Data":"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"}
Oct 30 22:11:02.920217 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.920184    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q" event={"ID":"086eb7c9-fe65-40f2-8aa1-b9bf829b575b","Type":"ContainerDied","Data":"49b0634d20a3c1f1c40c1963a68675a4538afcfa47c2ac3902a2ac5b5d8638a9"}
Oct 30 22:11:02.922126 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.922092    5579 generic.go:356] "Generic (PLEG): container finished" podID="0abe9df3-5680-446a-b468-ac26aea29e91" containerID="682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873" exitCode=0
Oct 30 22:11:02.922215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.922188    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" event={"ID":"0abe9df3-5680-446a-b468-ac26aea29e91","Type":"ContainerDied","Data":"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"}
Oct 30 22:11:02.922280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.922244    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh" event={"ID":"0abe9df3-5680-446a-b468-ac26aea29e91","Type":"ContainerDied","Data":"505658ecba86f3b5682c30d1afd398945039b611932201f264f80275027ce1e9"}
Oct 30 22:11:02.922450 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.922434    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"
Oct 30 22:11:02.933222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.933201    5579 scope.go:122] "RemoveContainer" containerID="62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"
Oct 30 22:11:02.933560 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:11:02.933529    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8\": container with ID starting with 62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8 not found: ID does not exist" containerID="62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"
Oct 30 22:11:02.933640 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.933574    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8"} err="failed to get container status \"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8\": rpc error: code = NotFound desc = could not find container \"62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8\": container with ID starting with 62c35e3687df3a616fdd154c4cf7ae8479a63d70da19e3451d13acc3adb627f8 not found: ID does not exist"
Oct 30 22:11:02.933640 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.933599    5579 scope.go:122] "RemoveContainer" containerID="f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"
Oct 30 22:11:02.948864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.948831    5579 scope.go:122] "RemoveContainer" containerID="f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"
Oct 30 22:11:02.949383 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:11:02.949356    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f\": container with ID starting with f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f not found: ID does not exist" containerID="f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"
Oct 30 22:11:02.949487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.949395    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f"} err="failed to get container status \"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f\": rpc error: code = NotFound desc = could not find container \"f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f\": container with ID starting with f321f1eb6c9b70ae06adcd92322d632542ac6d52bf1fdbc4a3baaa7fc6bfed9f not found: ID does not exist"
Oct 30 22:11:02.949487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.949422    5579 scope.go:122] "RemoveContainer" containerID="682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"
Oct 30 22:11:02.960090 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.960068    5579 scope.go:122] "RemoveContainer" containerID="682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"
Oct 30 22:11:02.960452 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:11:02.960413    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873\": container with ID starting with 682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873 not found: ID does not exist" containerID="682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"
Oct 30 22:11:02.960508 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:02.960461    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873"} err="failed to get container status \"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873\": rpc error: code = NotFound desc = could not find container \"682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873\": container with ID starting with 682a03606804a8728bc9550b438255fb9c77edae993d19b9c5dace7583a76873 not found: ID does not exist"
Oct 30 22:11:03.084625 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.084541    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:11:03.089837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.089808    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-j5w9q"]
Oct 30 22:11:03.149771 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.149415    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" path="/var/lib/kubelet/pods/086eb7c9-fe65-40f2-8aa1-b9bf829b575b/volumes"
Oct 30 22:11:03.193257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.193217    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 22:11:03.198762 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.198725    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-bh5kh"]
Oct 30 22:11:03.297751 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.297714    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:11:03.310013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:03.309975    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-xx8z2"]
Oct 30 22:11:05.147835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:05.147806    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" path="/var/lib/kubelet/pods/0abe9df3-5680-446a-b468-ac26aea29e91/volumes"
Oct 30 22:11:05.148345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:05.148330    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" path="/var/lib/kubelet/pods/a7151163-353a-462d-90a3-e1e90affb2a7/volumes"
Oct 30 22:11:05.905907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:11:05.905877    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:11:12.930738 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:11:12.930697    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:11:42.933301 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:11:42.933259    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:12:12.930620 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:12:12.930583    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:12:42.930975 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:12:42.930909    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:12:57.160056 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:12:57.160021    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 22:12:57.160583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:12:57.160237    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" containerID="cri-o://f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f" gracePeriod=30
Oct 30 22:12:57.205937 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:12:57.205901    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:12:57.206149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:12:57.206113    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy" containerID="cri-o://34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52" gracePeriod=30
Oct 30 22:13:01.202148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:01.202102    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:13:01.202563 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:01.202184    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:13:02.494745 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.494714    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 22:13:02.528522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.528496    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:13:02.581022 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.580991    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581056    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581077    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581123    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581202    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581246    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581276    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581304    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581335    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581340    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.581444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581371    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581461    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581501    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581537    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581590    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581616    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581682    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:02.581767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581693    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.582198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.581789    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.582198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582028    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.582198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582117    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:02.582198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582171    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.582423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582227    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\") pod \"07e765b0-07bd-4470-ac02-e3a57bdf6661\" (UID: \"07e765b0-07bd-4470-ac02-e3a57bdf6661\") "
Oct 30 22:13:02.582423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582257    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\") pod \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\" (UID: \"cbeb95ce-91bd-482f-84f7-bed3880f11a3\") "
Oct 30 22:13:02.582796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582598    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.582796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582753    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.582796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582767    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.582796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.582777    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583154    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583182    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e765b0-07bd-4470-ac02-e3a57bdf6661-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583197    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583212    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583228    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583242    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583256    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583270    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583284    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583298    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.583949 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.583898    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.584318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584298    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:02.584528 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584504    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:02.584591 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584507    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:13:02.584657 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584612    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx" pod "07e765b0-07bd-4470-ac02-e3a57bdf6661" (UID: "07e765b0-07bd-4470-ac02-e3a57bdf6661"). InnerVolumeSpecName "kube-api-access-h2bgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:02.584705 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584692    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "kube-api-access-tc2tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:02.585013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.584998    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:13:02.585204 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.585186    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token" pod "cbeb95ce-91bd-482f-84f7-bed3880f11a3" (UID: "cbeb95ce-91bd-482f-84f7-bed3880f11a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685064    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685097    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc2tv\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-kube-api-access-tc2tv\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685111    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685122    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2bgx\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-kube-api-access-h2bgx\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685137    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685149    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e765b0-07bd-4470-ac02-e3a57bdf6661-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685161    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.685532 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.685173    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbeb95ce-91bd-482f-84f7-bed3880f11a3-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:02.994291 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.994187    5579 generic.go:356] "Generic (PLEG): container finished" podID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerID="f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f" exitCode=0
Oct 30 22:13:02.994510 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.994276    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"
Oct 30 22:13:02.995340 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.994295    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" event={"ID":"07e765b0-07bd-4470-ac02-e3a57bdf6661","Type":"ContainerDied","Data":"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"}
Oct 30 22:13:02.995493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.995466    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs" event={"ID":"07e765b0-07bd-4470-ac02-e3a57bdf6661","Type":"ContainerDied","Data":"6634868618e2b55f881e1f1ab8644e35e116f60ec2fa58a46ed688a4cc0a191a"}
Oct 30 22:13:02.995565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.995544    5579 scope.go:122] "RemoveContainer" containerID="f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"
Oct 30 22:13:02.997678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.997645    5579 generic.go:356] "Generic (PLEG): container finished" podID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerID="34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52" exitCode=0
Oct 30 22:13:02.997832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.997701    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" event={"ID":"cbeb95ce-91bd-482f-84f7-bed3880f11a3","Type":"ContainerDied","Data":"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"}
Oct 30 22:13:02.997832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.997741    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776" event={"ID":"cbeb95ce-91bd-482f-84f7-bed3880f11a3","Type":"ContainerDied","Data":"2ce22d1a9344c87305d6b6fcdf75cd1ba8fef5f5bc8506fe01cc11d46bacda67"}
Oct 30 22:13:02.997832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:02.997832    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"
Oct 30 22:13:03.019664 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.019637    5579 scope.go:122] "RemoveContainer" containerID="f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"
Oct 30 22:13:03.020522 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:03.020364    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f\": container with ID starting with f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f not found: ID does not exist" containerID="f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"
Oct 30 22:13:03.020522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.020407    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f"} err="failed to get container status \"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f\": rpc error: code = NotFound desc = could not find container \"f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f\": container with ID starting with f58f5f43cfe94cae73f5a38b5e413ee592d6048ec1bae3d68cc1fb6b5eae011f not found: ID does not exist"
Oct 30 22:13:03.020522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.020436    5579 scope.go:122] "RemoveContainer" containerID="34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"
Oct 30 22:13:03.031494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.031473    5579 scope.go:122] "RemoveContainer" containerID="34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"
Oct 30 22:13:03.031855 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:03.031835    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52\": container with ID starting with 34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52 not found: ID does not exist" containerID="34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"
Oct 30 22:13:03.031963 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.031863    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52"} err="failed to get container status \"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52\": rpc error: code = NotFound desc = could not find container \"34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52\": container with ID starting with 34ec719c313e80d60335cc6b2a0e7542ecfa4e0bc3438fdbc13530279d1bce52 not found: ID does not exist"
Oct 30 22:13:03.211331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.211296    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:13:03.236509 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.236468    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-sl776"]
Oct 30 22:13:03.355642 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.355561    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 22:13:03.362034 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:03.362004    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-95vgs"]
Oct 30 22:13:05.147342 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:05.147312    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" path="/var/lib/kubelet/pods/07e765b0-07bd-4470-ac02-e3a57bdf6661/volumes"
Oct 30 22:13:05.147785 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:05.147770    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" path="/var/lib/kubelet/pods/cbeb95ce-91bd-482f-84f7-bed3880f11a3/volumes"
Oct 30 22:13:12.935014 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:12.934972    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:13:34.081362 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.081270    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:13:34.082128 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082107    5579 cpu_manager.go:414] "containerMap: removing container" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082130    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082153    5579 cpu_manager.go:414] "containerMap: removing container" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082160    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082200    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082207    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082219    5579 cpu_manager.go:414] "containerMap: removing container" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082226    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy"
Oct 30 22:13:34.082241 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082240    5579 cpu_manager.go:414] "containerMap: removing container" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082247    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082401    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="086eb7c9-fe65-40f2-8aa1-b9bf829b575b" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082415    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="0abe9df3-5680-446a-b468-ac26aea29e91" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082434    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="07e765b0-07bd-4470-ac02-e3a57bdf6661" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082444    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7151163-353a-462d-90a3-e1e90affb2a7" containerName="istio-proxy"
Oct 30 22:13:34.082630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.082455    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbeb95ce-91bd-482f-84f7-bed3880f11a3" containerName="istio-proxy"
Oct 30 22:13:34.087632 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.087608    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.137151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.137111    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5fef81-serving-cert\""
Oct 30 22:13:34.186825 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.186783    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:13:34.268475 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.268435    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.268691 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.268663    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.269045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.269016    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.269199 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.269062    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlwr\" (UniqueName: \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.370881 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.370741    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.371143 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.370881    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.371143 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.371020    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.371262 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.371237    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlwr\" (UniqueName: \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.371509 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:34.371474    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-serving-cert: secret "maas-api-e2e-api-a-5fef81-serving-cert" not found
Oct 30 22:13:34.372477 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:34.372459    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls podName:c86b9208-11fe-431e-9072-efc30a2ede19 nodeName:}" failed. No retries permitted until 2026-10-30 22:13:34.872438908 +0000 UTC m=+1819.842285297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls") pod "maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" (UID: "c86b9208-11fe-431e-9072-efc30a2ede19") : secret "maas-api-e2e-api-a-5fef81-serving-cert" not found
Oct 30 22:13:34.372606 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.372363    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.374549 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.374530    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.426950 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.426900    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlwr\" (UniqueName: \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.879067 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.879034    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:34.881541 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:34.881513    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") pod \"maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:35.001588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:35.001554    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:35.378678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:35.378647    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:13:35.382702 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:13:35.382672    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86b9208_11fe_431e_9072_efc30a2ede19.slice/crio-c950ca490faec490489e2560bf7dda5f8c6971d58fb8fb389bbacc397a18a408 WatchSource:0}: Error finding container c950ca490faec490489e2560bf7dda5f8c6971d58fb8fb389bbacc397a18a408: Status 404 returned error can't find the container with id c950ca490faec490489e2560bf7dda5f8c6971d58fb8fb389bbacc397a18a408
Oct 30 22:13:36.356851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:36.356817    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" event={"ID":"c86b9208-11fe-431e-9072-efc30a2ede19","Type":"ContainerStarted","Data":"c950ca490faec490489e2560bf7dda5f8c6971d58fb8fb389bbacc397a18a408"}
Oct 30 22:13:37.364608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:37.364575    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" event={"ID":"c86b9208-11fe-431e-9072-efc30a2ede19","Type":"ContainerStarted","Data":"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"}
Oct 30 22:13:37.365138 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:37.364706    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:37.477058 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:37.477000    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" podStartSLOduration=2.571591344 podStartE2EDuration="3.476983372s" totalImagesPullingTime="905.392028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:37.474732271 +0000 UTC m=+1822.444578679" watchObservedRunningTime="2026-10-30 22:13:37.476983372 +0000 UTC m=+1822.446829780"
Oct 30 22:13:42.711028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:42.710990    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:13:42.711514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:42.711233    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" podUID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" containerName="maas-api" containerID="cri-o://7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e" gracePeriod=30
Oct 30 22:13:43.021018 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:43.020579    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:13:43.097320 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.097289    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:13:43.204171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.203432    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\" (UniqueName: \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\") pod \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") "
Oct 30 22:13:43.204171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.203524    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") pod \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") "
Oct 30 22:13:43.204171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.203659    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\") pod \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") "
Oct 30 22:13:43.204171 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.203837    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\") pod \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\" (UID: \"53901d6e-dc2c-4f6b-bc31-256d82dcb209\") "
Oct 30 22:13:43.209200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.209141    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca" pod "53901d6e-dc2c-4f6b-bc31-256d82dcb209" (UID: "53901d6e-dc2c-4f6b-bc31-256d82dcb209"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:43.242969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.219401    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs" pod "53901d6e-dc2c-4f6b-bc31-256d82dcb209" (UID: "53901d6e-dc2c-4f6b-bc31-256d82dcb209"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:43.242969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.223122    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls" pod "53901d6e-dc2c-4f6b-bc31-256d82dcb209" (UID: "53901d6e-dc2c-4f6b-bc31-256d82dcb209"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:43.242969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.241107    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n" pod "53901d6e-dc2c-4f6b-bc31-256d82dcb209" (UID: "53901d6e-dc2c-4f6b-bc31-256d82dcb209"). InnerVolumeSpecName "kube-api-access-fss7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:43.305680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.305593    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fss7n\" (UniqueName: \"kubernetes.io/projected/53901d6e-dc2c-4f6b-bc31-256d82dcb209-kube-api-access-fss7n\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:43.305680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.305626    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:43.305680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.305636    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53901d6e-dc2c-4f6b-bc31-256d82dcb209-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:43.305680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.305644    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53901d6e-dc2c-4f6b-bc31-256d82dcb209-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:13:43.377510 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.377484    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:13:43.404629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.404595    5579 generic.go:356] "Generic (PLEG): container finished" podID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" containerID="7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e" exitCode=0
Oct 30 22:13:43.404808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.404640    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"
Oct 30 22:13:43.404808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.404673    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" event={"ID":"53901d6e-dc2c-4f6b-bc31-256d82dcb209","Type":"ContainerDied","Data":"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"}
Oct 30 22:13:43.404808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.404725    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5" event={"ID":"53901d6e-dc2c-4f6b-bc31-256d82dcb209","Type":"ContainerDied","Data":"e07e7bfa44fa230a0af08afe008957d0acbb0831a4d2279a75ef5183f0934a49"}
Oct 30 22:13:43.404808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.404752    5579 scope.go:122] "RemoveContainer" containerID="7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"
Oct 30 22:13:43.415264 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.415242    5579 scope.go:122] "RemoveContainer" containerID="7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"
Oct 30 22:13:43.415502 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:13:43.415482    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e\": container with ID starting with 7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e not found: ID does not exist" containerID="7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"
Oct 30 22:13:43.415586 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.415516    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e"} err="failed to get container status \"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e\": rpc error: code = NotFound desc = could not find container \"7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e\": container with ID starting with 7c4263095cabaed8950bd537235c07e31933adbaf98938d2293576b950e5284e not found: ID does not exist"
Oct 30 22:13:43.594452 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.594368    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:13:43.599217 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:43.599190    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d434591-f7ddc6f-878s5"]
Oct 30 22:13:45.146525 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:13:45.146492    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" path="/var/lib/kubelet/pods/53901d6e-dc2c-4f6b-bc31-256d82dcb209/volumes"
Oct 30 22:14:12.932197 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:14:12.932150    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:14:42.931125 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:14:42.931089    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:15:00.350629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.350446    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:00.351747 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.351710    5579 cpu_manager.go:414] "containerMap: removing container" podUID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" containerName="maas-api"
Oct 30 22:15:00.351747 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.351745    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" containerName="maas-api"
Oct 30 22:15:00.352161 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.351972    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="53901d6e-dc2c-4f6b-bc31-256d82dcb209" containerName="maas-api"
Oct 30 22:15:00.358252 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.358224    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.386311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.386263    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqcgb\" (UniqueName: \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.386487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.386324    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.442768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.442728    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:00.454565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.454539    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gdmfg\""
Oct 30 22:15:00.487551 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.487515    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqcgb\" (UniqueName: \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.487741 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.487563    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.488262 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.488243    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.550254 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.550221    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqcgb\" (UniqueName: \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\") pod \"maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:00.676296 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:00.676253    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:01.058397 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:01.058311    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:01.063835 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:01.063808    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce598c82_dce1_4baa_bacf_122d6169d243.slice/crio-cd339ef13229bf2c0b54dc89b112c2872ef1162f441eb083ddafdd5ccc6479c2 WatchSource:0}: Error finding container cd339ef13229bf2c0b54dc89b112c2872ef1162f441eb083ddafdd5ccc6479c2: Status 404 returned error can't find the container with id cd339ef13229bf2c0b54dc89b112c2872ef1162f441eb083ddafdd5ccc6479c2
Oct 30 22:15:01.949768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:01.949732    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerStarted","Data":"cd339ef13229bf2c0b54dc89b112c2872ef1162f441eb083ddafdd5ccc6479c2"}
Oct 30 22:15:03.880712 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:03.880673    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-d1d4fb"]
Oct 30 22:15:03.886826 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:03.886053    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:03.933067 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:03.933022    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjwk\" (UniqueName: \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\") pod \"test-curl-7179-d1d4fb\" (UID: \"d1da2289-3fd9-450f-b6a2-38e6903faf15\") " pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:03.982416 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:03.982365    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-74ld5\""
Oct 30 22:15:03.986552 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:03.986520    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-d1d4fb"]
Oct 30 22:15:04.034501 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.034459    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjwk\" (UniqueName: \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\") pod \"test-curl-7179-d1d4fb\" (UID: \"d1da2289-3fd9-450f-b6a2-38e6903faf15\") " pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:04.107298 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.107270    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjwk\" (UniqueName: \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\") pod \"test-curl-7179-d1d4fb\" (UID: \"d1da2289-3fd9-450f-b6a2-38e6903faf15\") " pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:04.202382 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.202343    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:04.589512 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.589384    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-d1d4fb"]
Oct 30 22:15:04.594449 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:04.594415    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1da2289_3fd9_450f_b6a2_38e6903faf15.slice/crio-2b02ff2f0a6f1d2a844e90761fd3c30eec81b777ba28e99404b4a05338581455 WatchSource:0}: Error finding container 2b02ff2f0a6f1d2a844e90761fd3c30eec81b777ba28e99404b4a05338581455: Status 404 returned error can't find the container with id 2b02ff2f0a6f1d2a844e90761fd3c30eec81b777ba28e99404b4a05338581455
Oct 30 22:15:04.975898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.975861    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-d1d4fb" event={"ID":"d1da2289-3fd9-450f-b6a2-38e6903faf15","Type":"ContainerStarted","Data":"f608e5b0917e2b18554c52f9d2dedb97b12607f6e08187eca181e6e376e37dfb"}
Oct 30 22:15:04.976334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:04.975913    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-d1d4fb" event={"ID":"d1da2289-3fd9-450f-b6a2-38e6903faf15","Type":"ContainerStarted","Data":"2b02ff2f0a6f1d2a844e90761fd3c30eec81b777ba28e99404b4a05338581455"}
Oct 30 22:15:05.084673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:05.084619    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7179-d1d4fb" podStartSLOduration=2.084605235 podStartE2EDuration="2.084605235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:05.083655984 +0000 UTC m=+1910.053502419" watchObservedRunningTime="2026-10-30 22:15:05.084605235 +0000 UTC m=+1910.054451701"
Oct 30 22:15:05.984847 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:05.984813    5579 generic.go:356] "Generic (PLEG): container finished" podID="ce598c82-dce1-4baa-bacf-122d6169d243" containerID="e8a3384b6e6c689cdc327676e66ae5fef19a44acf91bbfd77526113e998ba73b" exitCode=60
Oct 30 22:15:05.985325 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:05.984894    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerDied","Data":"e8a3384b6e6c689cdc327676e66ae5fef19a44acf91bbfd77526113e998ba73b"}
Oct 30 22:15:05.985325 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:05.985188    5579 scope.go:122] "RemoveContainer" containerID="e8a3384b6e6c689cdc327676e66ae5fef19a44acf91bbfd77526113e998ba73b"
Oct 30 22:15:06.601984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.601862    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-d1d4fb"]
Oct 30 22:15:06.605643 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.605614    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-d1d4fb"]
Oct 30 22:15:06.767621 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.767582    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-64719b"]
Oct 30 22:15:06.768405 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.768384    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" containerName="test-curl-7179-d1d4fb"
Oct 30 22:15:06.768496 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.768408    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" containerName="test-curl-7179-d1d4fb"
Oct 30 22:15:06.768608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.768594    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" containerName="test-curl-7179-d1d4fb"
Oct 30 22:15:06.772484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.772463    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:06.829728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.829697    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-64719b"]
Oct 30 22:15:06.875317 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.875227    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vddmz\" (UniqueName: \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\") pod \"test-curl-7179-64719b\" (UID: \"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0\") " pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:06.976461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.976424    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vddmz\" (UniqueName: \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\") pod \"test-curl-7179-64719b\" (UID: \"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0\") " pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:06.994653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.994622    5579 generic.go:356] "Generic (PLEG): container finished" podID="ce598c82-dce1-4baa-bacf-122d6169d243" containerID="480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960" exitCode=60
Oct 30 22:15:06.995084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.994705    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerDied","Data":"480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960"}
Oct 30 22:15:06.995084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.994761    5579 scope.go:122] "RemoveContainer" containerID="e8a3384b6e6c689cdc327676e66ae5fef19a44acf91bbfd77526113e998ba73b"
Oct 30 22:15:06.995084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.994970    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7179-d1d4fb" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" containerName="test-curl-7179-d1d4fb" containerID="cri-o://f608e5b0917e2b18554c52f9d2dedb97b12607f6e08187eca181e6e376e37dfb" gracePeriod=2
Oct 30 22:15:06.995263 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:06.995108    5579 scope.go:122] "RemoveContainer" containerID="480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960"
Oct 30 22:15:06.995453 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:06.995429    5579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr_odh-ai-gateway-infra(ce598c82-dce1-4baa-bacf-122d6169d243)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" podUID="ce598c82-dce1-4baa-bacf-122d6169d243"
Oct 30 22:15:07.030429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:07.030401    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vddmz\" (UniqueName: \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\") pod \"test-curl-7179-64719b\" (UID: \"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0\") " pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:07.085634 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:07.085602    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:07.150906 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:07.150874    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-d1d4fb\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:07.460445 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:07.460366    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-64719b"]
Oct 30 22:15:07.464603 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:07.464579    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e17fb0a_2c4b_45fc_b7e3_4f122d2130d0.slice/crio-86810c964a6cec389e9b1fa4fdc50e02e660ef2c8eb536678785c6fd8e922d56 WatchSource:0}: Error finding container 86810c964a6cec389e9b1fa4fdc50e02e660ef2c8eb536678785c6fd8e922d56: Status 404 returned error can't find the container with id 86810c964a6cec389e9b1fa4fdc50e02e660ef2c8eb536678785c6fd8e922d56
Oct 30 22:15:08.047343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:08.046232    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-64719b" event={"ID":"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0","Type":"ContainerStarted","Data":"5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85"}
Oct 30 22:15:08.047343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:08.046284    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-64719b" event={"ID":"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0","Type":"ContainerStarted","Data":"86810c964a6cec389e9b1fa4fdc50e02e660ef2c8eb536678785c6fd8e922d56"}
Oct 30 22:15:08.054066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:08.054040    5579 scope.go:122] "RemoveContainer" containerID="480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960"
Oct 30 22:15:08.054908 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:08.054874    5579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr_odh-ai-gateway-infra(ce598c82-dce1-4baa-bacf-122d6169d243)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" podUID="ce598c82-dce1-4baa-bacf-122d6169d243"
Oct 30 22:15:08.155096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:08.155042    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7179-64719b" podStartSLOduration=2.155027567 podStartE2EDuration="2.155027567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:08.154196854 +0000 UTC m=+1913.124043262" watchObservedRunningTime="2026-10-30 22:15:08.155027567 +0000 UTC m=+1913.124874031"
Oct 30 22:15:09.063081 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.063047    5579 generic.go:356] "Generic (PLEG): container finished" podID="d1da2289-3fd9-450f-b6a2-38e6903faf15" containerID="f608e5b0917e2b18554c52f9d2dedb97b12607f6e08187eca181e6e376e37dfb" exitCode=137
Oct 30 22:15:09.245710 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.245685    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:09.334569 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.334481    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\" (UniqueName: \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\") pod \"d1da2289-3fd9-450f-b6a2-38e6903faf15\" (UID: \"d1da2289-3fd9-450f-b6a2-38e6903faf15\") "
Oct 30 22:15:09.336606 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.336578    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk" pod "d1da2289-3fd9-450f-b6a2-38e6903faf15" (UID: "d1da2289-3fd9-450f-b6a2-38e6903faf15"). InnerVolumeSpecName "kube-api-access-hcjwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:09.436520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.436485    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcjwk\" (UniqueName: \"kubernetes.io/projected/d1da2289-3fd9-450f-b6a2-38e6903faf15-kube-api-access-hcjwk\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:09.684601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.684568    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-64719b"]
Oct 30 22:15:09.687838 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.687803    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-64719b"]
Oct 30 22:15:09.837732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.837698    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-791404"]
Oct 30 22:15:09.838366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.838348    5579 cpu_manager.go:414] "containerMap: removing container" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" containerName="test-curl-7179-64719b"
Oct 30 22:15:09.838428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.838368    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" containerName="test-curl-7179-64719b"
Oct 30 22:15:09.838483 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.838474    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" containerName="test-curl-7179-64719b"
Oct 30 22:15:09.842157 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.842135    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:09.905783 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.905745    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-791404"]
Oct 30 22:15:09.942509 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:09.942419    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rjw\" (UniqueName: \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\") pod \"test-curl-7179-791404\" (UID: \"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427\") " pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:10.044233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.044191    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rjw\" (UniqueName: \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\") pod \"test-curl-7179-791404\" (UID: \"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427\") " pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:10.072922 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.072891    5579 scope.go:122] "RemoveContainer" containerID="f608e5b0917e2b18554c52f9d2dedb97b12607f6e08187eca181e6e376e37dfb"
Oct 30 22:15:10.072922 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.072902    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:10.073480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.073014    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7179-64719b" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" containerName="test-curl-7179-64719b" containerID="cri-o://5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85" gracePeriod=2
Oct 30 22:15:10.103638 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.103608    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rjw\" (UniqueName: \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\") pod \"test-curl-7179-791404\" (UID: \"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427\") " pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:10.120665 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:10.120630    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-64719b\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:10.154340 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.154307    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:10.168434 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:10.168399    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-64719b\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:10.216266 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:10.216227    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-d1d4fb\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:10.531172 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:10.531079    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-791404"]
Oct 30 22:15:10.536190 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:10.536164    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56e28d3e_77d8_47c3_88c7_b3f9d2a0c427.slice/crio-eb85598078f9eeba0efdc1c6212a9ccbcefe46b0051ab3f1bffb2bc63abbcee9 WatchSource:0}: Error finding container eb85598078f9eeba0efdc1c6212a9ccbcefe46b0051ab3f1bffb2bc63abbcee9: Status 404 returned error can't find the container with id eb85598078f9eeba0efdc1c6212a9ccbcefe46b0051ab3f1bffb2bc63abbcee9
Oct 30 22:15:11.091564 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:11.091525    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-791404" event={"ID":"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427","Type":"ContainerStarted","Data":"a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190"}
Oct 30 22:15:11.091564 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:11.091566    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-791404" event={"ID":"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427","Type":"ContainerStarted","Data":"eb85598078f9eeba0efdc1c6212a9ccbcefe46b0051ab3f1bffb2bc63abbcee9"}
Oct 30 22:15:11.139479 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:11.139442    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-64719b\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:11.148069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:11.148035    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" path="/var/lib/kubelet/pods/d1da2289-3fd9-450f-b6a2-38e6903faf15/volumes"
Oct 30 22:15:11.245471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:11.245414    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7179-791404" podStartSLOduration=2.24539921 podStartE2EDuration="2.24539921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:11.244123569 +0000 UTC m=+1916.213969980" watchObservedRunningTime="2026-10-30 22:15:11.24539921 +0000 UTC m=+1916.215245619"
Oct 30 22:15:11.291603 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:11.291565    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-d1d4fb\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="d1da2289-3fd9-450f-b6a2-38e6903faf15" pod="opendatahub/test-curl-7179-d1d4fb"
Oct 30 22:15:12.343346 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:12.343281    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:12.476899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:12.476866    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\" (UniqueName: \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\") pod \"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0\" (UID: \"9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0\") "
Oct 30 22:15:12.478958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:12.478923    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz" pod "9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" (UID: "9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0"). InnerVolumeSpecName "kube-api-access-vddmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:12.578409 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:12.578379    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vddmz\" (UniqueName: \"kubernetes.io/projected/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0-kube-api-access-vddmz\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:12.931366 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:12.931324    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:15:13.108625 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.108588    5579 generic.go:356] "Generic (PLEG): container finished" podID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" containerID="5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85" exitCode=137
Oct 30 22:15:13.108625 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.108627    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:13.108871 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.108638    5579 scope.go:122] "RemoveContainer" containerID="5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85"
Oct 30 22:15:13.118793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.118753    5579 scope.go:122] "RemoveContainer" containerID="5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85"
Oct 30 22:15:13.119082 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:13.119063    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85\": container with ID starting with 5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85 not found: ID does not exist" containerID="5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85"
Oct 30 22:15:13.119161 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.119090    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85"} err="failed to get container status \"5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85\": rpc error: code = NotFound desc = could not find container \"5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85\": container with ID starting with 5b359609c6a1a63922a5e62b2017a295cea111b18e86038bbff0c14d75d61b85 not found: ID does not exist"
Oct 30 22:15:13.147270 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:13.147238    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" path="/var/lib/kubelet/pods/9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0/volumes"
Oct 30 22:15:13.165055 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:13.165028    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-64719b\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="9e17fb0a-2c4b-45fc-b7e3-4f122d2130d0" pod="opendatahub/test-curl-7179-64719b"
Oct 30 22:15:14.293261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.293226    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7185-36b4e1"]
Oct 30 22:15:14.298983 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.298955    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:14.356130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.356095    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-36b4e1"]
Oct 30 22:15:14.403556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.403519    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhq9x\" (UniqueName: \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\") pod \"test-curl-7185-36b4e1\" (UID: \"6ad83f85-dc91-43a3-ba65-63ae7680bfdd\") " pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:14.504697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.504662    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhq9x\" (UniqueName: \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\") pod \"test-curl-7185-36b4e1\" (UID: \"6ad83f85-dc91-43a3-ba65-63ae7680bfdd\") " pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:14.559067 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.558990    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhq9x\" (UniqueName: \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\") pod \"test-curl-7185-36b4e1\" (UID: \"6ad83f85-dc91-43a3-ba65-63ae7680bfdd\") " pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:14.611588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.611551    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:14.983694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:14.983659    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-36b4e1"]
Oct 30 22:15:14.988333 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:14.988294    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ad83f85_dc91_43a3_ba65_63ae7680bfdd.slice/crio-f463f9b44f061afc020e969377b15c628fc31d2a0769ca5b7de7df703b151e4b WatchSource:0}: Error finding container f463f9b44f061afc020e969377b15c628fc31d2a0769ca5b7de7df703b151e4b: Status 404 returned error can't find the container with id f463f9b44f061afc020e969377b15c628fc31d2a0769ca5b7de7df703b151e4b
Oct 30 22:15:15.124651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:15.124612    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-36b4e1" event={"ID":"6ad83f85-dc91-43a3-ba65-63ae7680bfdd","Type":"ContainerStarted","Data":"fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8"}
Oct 30 22:15:15.124651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:15.124654    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-36b4e1" event={"ID":"6ad83f85-dc91-43a3-ba65-63ae7680bfdd","Type":"ContainerStarted","Data":"f463f9b44f061afc020e969377b15c628fc31d2a0769ca5b7de7df703b151e4b"}
Oct 30 22:15:15.232913 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:15.232861    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7185-36b4e1" podStartSLOduration=1.232846713 podStartE2EDuration="1.232846713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:15.232478895 +0000 UTC m=+1920.202325307" watchObservedRunningTime="2026-10-30 22:15:15.232846713 +0000 UTC m=+1920.202693124"
Oct 30 22:15:16.622573 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:16.622536    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7185-36b4e1"]
Oct 30 22:15:16.629352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:16.629322    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7185-36b4e1"]
Oct 30 22:15:17.139040 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:17.139003    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7185-36b4e1" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" containerName="test-curl-7185-36b4e1" containerID="cri-o://fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8" gracePeriod=2
Oct 30 22:15:17.148047 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:17.148021    5579 scope.go:122] "RemoveContainer" containerID="480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960"
Oct 30 22:15:17.186916 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:17.186877    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-36b4e1\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:18.149968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:18.149895    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerStarted","Data":"b424f0886078b52f5c796608e341527637c8c4abfb0684643e52588a55becb1b"}
Oct 30 22:15:18.262055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:18.262006    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" podStartSLOduration=14.28625179 podStartE2EDuration="18.261992708s" totalImagesPullingTime="3.975740918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:18.259187596 +0000 UTC m=+1923.229034006" watchObservedRunningTime="2026-10-30 22:15:18.261992708 +0000 UTC m=+1923.231839120"
Oct 30 22:15:19.159174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.159140    5579 generic.go:356] "Generic (PLEG): container finished" podID="ce598c82-dce1-4baa-bacf-122d6169d243" containerID="b424f0886078b52f5c796608e341527637c8c4abfb0684643e52588a55becb1b" exitCode=60
Oct 30 22:15:19.159739 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.159323    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerDied","Data":"b424f0886078b52f5c796608e341527637c8c4abfb0684643e52588a55becb1b"}
Oct 30 22:15:19.159739 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.159670    5579 scope.go:122] "RemoveContainer" containerID="480784645f040a50d404a2e76d48d2a10c13eadacf65f7d09b02277742456960"
Oct 30 22:15:19.160156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.160134    5579 scope.go:122] "RemoveContainer" containerID="b424f0886078b52f5c796608e341527637c8c4abfb0684643e52588a55becb1b"
Oct 30 22:15:19.160502 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:19.160481    5579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr_odh-ai-gateway-infra(ce598c82-dce1-4baa-bacf-122d6169d243)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" podUID="ce598c82-dce1-4baa-bacf-122d6169d243"
Oct 30 22:15:19.284634 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.284594    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:19.392975 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.392898    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:19.468000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.467961    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\" (UniqueName: \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\") pod \"6ad83f85-dc91-43a3-ba65-63ae7680bfdd\" (UID: \"6ad83f85-dc91-43a3-ba65-63ae7680bfdd\") "
Oct 30 22:15:19.470135 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.470104    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x" pod "6ad83f85-dc91-43a3-ba65-63ae7680bfdd" (UID: "6ad83f85-dc91-43a3-ba65-63ae7680bfdd"). InnerVolumeSpecName "kube-api-access-vhq9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:19.570209 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:19.570166    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhq9x\" (UniqueName: \"kubernetes.io/projected/6ad83f85-dc91-43a3-ba65-63ae7680bfdd-kube-api-access-vhq9x\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:20.167765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.167733    5579 generic.go:356] "Generic (PLEG): container finished" podID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" containerID="fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8" exitCode=137
Oct 30 22:15:20.168181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.167774    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:20.168181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.167827    5579 scope.go:122] "RemoveContainer" containerID="fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8"
Oct 30 22:15:20.179515 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.179489    5579 scope.go:122] "RemoveContainer" containerID="fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8"
Oct 30 22:15:20.179836 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:20.179816    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8\": container with ID starting with fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8 not found: ID does not exist" containerID="fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8"
Oct 30 22:15:20.179898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.179847    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8"} err="failed to get container status \"fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8\": rpc error: code = NotFound desc = could not find container \"fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8\": container with ID starting with fa317d8fd8b73ec4385e0a7f1f9becc0c885dba90f4690fc60ba41c0b81d3dd8 not found: ID does not exist"
Oct 30 22:15:20.347166 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.347142    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:20.373471 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:20.373433    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-36b4e1\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:20.380942 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.380902    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\") pod \"ce598c82-dce1-4baa-bacf-122d6169d243\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") "
Oct 30 22:15:20.381100 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.381083    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\" (UniqueName: \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\") pod \"ce598c82-dce1-4baa-bacf-122d6169d243\" (UID: \"ce598c82-dce1-4baa-bacf-122d6169d243\") "
Oct 30 22:15:20.381279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.381251    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca" pod "ce598c82-dce1-4baa-bacf-122d6169d243" (UID: "ce598c82-dce1-4baa-bacf-122d6169d243"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:20.381639 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.381621    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce598c82-dce1-4baa-bacf-122d6169d243-maas-api-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:20.383510 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.383481    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb" pod "ce598c82-dce1-4baa-bacf-122d6169d243" (UID: "ce598c82-dce1-4baa-bacf-122d6169d243"). InnerVolumeSpecName "kube-api-access-qqcgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:20.483316 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:20.483230    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqcgb\" (UniqueName: \"kubernetes.io/projected/ce598c82-dce1-4baa-bacf-122d6169d243-kube-api-access-qqcgb\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:20.529161 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:20.529112    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-36b4e1\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" pod="opendatahub/test-curl-7185-36b4e1"
Oct 30 22:15:21.150653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.150618    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" path="/var/lib/kubelet/pods/6ad83f85-dc91-43a3-ba65-63ae7680bfdd/volumes"
Oct 30 22:15:21.177841 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.177815    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"
Oct 30 22:15:21.178318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.177909    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr" event={"ID":"ce598c82-dce1-4baa-bacf-122d6169d243","Type":"ContainerDied","Data":"cd339ef13229bf2c0b54dc89b112c2872ef1162f441eb083ddafdd5ccc6479c2"}
Oct 30 22:15:21.178318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.178152    5579 scope.go:122] "RemoveContainer" containerID="b424f0886078b52f5c796608e341527637c8c4abfb0684643e52588a55becb1b"
Oct 30 22:15:21.334961 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.334907    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:21.379072 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:21.379033    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a07620-29889975-zqcdr"]
Oct 30 22:15:22.728869 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.728831    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-791404"]
Oct 30 22:15:22.729465 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.729108    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7179-791404" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" containerName="test-curl-7179-791404" containerID="cri-o://a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190" gracePeriod=2
Oct 30 22:15:22.732633 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.732611    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-791404"]
Oct 30 22:15:22.776692 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:22.776651    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-791404\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:22.886890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.886858    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-c16680"]
Oct 30 22:15:22.887444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887425    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887441    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887451    5579 cpu_manager.go:414] "containerMap: removing container" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" containerName="test-curl-7185-36b4e1"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887456    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" containerName="test-curl-7185-36b4e1"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887478    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887484    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887524    5579 cpu_manager.go:414] "containerMap: removing container" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" containerName="test-curl-7179-791404"
Oct 30 22:15:22.887601 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887529    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" containerName="test-curl-7179-791404"
Oct 30 22:15:22.887787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887610    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" containerName="test-curl-7179-791404"
Oct 30 22:15:22.887787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887620    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887628    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887635    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:22.887787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.887640    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ad83f85-dc91-43a3-ba65-63ae7680bfdd" containerName="test-curl-7185-36b4e1"
Oct 30 22:15:22.892217 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.892199    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:22.915313 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.915286    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbs4x\" (UniqueName: \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\") pod \"test-curl-7179-c16680\" (UID: \"4eb725e3-0a24-486f-9461-b9b8295b3dca\") " pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:22.939955 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:22.939912    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-791404\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:22.948513 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:22.948486    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-c16680"]
Oct 30 22:15:23.016813 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:23.016736    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbs4x\" (UniqueName: \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\") pod \"test-curl-7179-c16680\" (UID: \"4eb725e3-0a24-486f-9461-b9b8295b3dca\") " pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:23.073322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:23.073292    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbs4x\" (UniqueName: \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\") pod \"test-curl-7179-c16680\" (UID: \"4eb725e3-0a24-486f-9461-b9b8295b3dca\") " pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:23.147815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:23.147783    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" path="/var/lib/kubelet/pods/ce598c82-dce1-4baa-bacf-122d6169d243/volumes"
Oct 30 22:15:23.205613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:23.205584    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:23.603380 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:23.603294    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-c16680"]
Oct 30 22:15:23.608754 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:23.608729    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb725e3_0a24_486f_9461_b9b8295b3dca.slice/crio-0287575bc32fead36c2cc3927793eee514b6cde14fc6db6eca44d1fc7077be01 WatchSource:0}: Error finding container 0287575bc32fead36c2cc3927793eee514b6cde14fc6db6eca44d1fc7077be01: Status 404 returned error can't find the container with id 0287575bc32fead36c2cc3927793eee514b6cde14fc6db6eca44d1fc7077be01
Oct 30 22:15:24.210429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:24.210390    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-c16680" event={"ID":"4eb725e3-0a24-486f-9461-b9b8295b3dca","Type":"ContainerStarted","Data":"1d4b92525ce07dd3201e93bcbe36d18a06239b0404f53e6779df63cc8df2a6b3"}
Oct 30 22:15:24.210429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:24.210439    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-c16680" event={"ID":"4eb725e3-0a24-486f-9461-b9b8295b3dca","Type":"ContainerStarted","Data":"0287575bc32fead36c2cc3927793eee514b6cde14fc6db6eca44d1fc7077be01"}
Oct 30 22:15:24.322951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:24.322868    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7179-c16680" podStartSLOduration=2.322850612 podStartE2EDuration="2.322850612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:24.317208329 +0000 UTC m=+1929.287054738" watchObservedRunningTime="2026-10-30 22:15:24.322850612 +0000 UTC m=+1929.292697023"
Oct 30 22:15:25.133332 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.133302    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:25.221987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.221081    5579 generic.go:356] "Generic (PLEG): container finished" podID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" containerID="a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190" exitCode=137
Oct 30 22:15:25.221987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.221135    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-791404"
Oct 30 22:15:25.221987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.221668    5579 scope.go:122] "RemoveContainer" containerID="a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190"
Oct 30 22:15:25.237230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.237064    5579 scope.go:122] "RemoveContainer" containerID="a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190"
Oct 30 22:15:25.237719 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:25.237696    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190\": container with ID starting with a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190 not found: ID does not exist" containerID="a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190"
Oct 30 22:15:25.237881 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.237753    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190"} err="failed to get container status \"a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190\": rpc error: code = NotFound desc = could not find container \"a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190\": container with ID starting with a3cc01ad9c7759a84bd607bce3063a7347b097fb6d8ff4d72ff3eecd0789b190 not found: ID does not exist"
Oct 30 22:15:25.276082 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.272812    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\" (UniqueName: \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\") pod \"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427\" (UID: \"56e28d3e-77d8-47c3-88c7-b3f9d2a0c427\") "
Oct 30 22:15:25.302218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.295818    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw" pod "56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" (UID: "56e28d3e-77d8-47c3-88c7-b3f9d2a0c427"). InnerVolumeSpecName "kube-api-access-l4rjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:25.374840 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.374798    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4rjw\" (UniqueName: \"kubernetes.io/projected/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427-kube-api-access-l4rjw\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:25.828632 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.828542    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-c16680"]
Oct 30 22:15:25.832615 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:25.832583    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-c16680"]
Oct 30 22:15:26.228245 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:26.228205    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7179-c16680" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" containerName="test-curl-7179-c16680" containerID="cri-o://1d4b92525ce07dd3201e93bcbe36d18a06239b0404f53e6779df63cc8df2a6b3" gracePeriod=2
Oct 30 22:15:26.276240 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:26.276201    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7179-c16680\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:27.306421 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:27.306008    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56e28d3e-77d8-47c3-88c7-b3f9d2a0c427" path="/var/lib/kubelet/pods/56e28d3e-77d8-47c3-88c7-b3f9d2a0c427/volumes"
Oct 30 22:15:28.319884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.319849    5579 generic.go:356] "Generic (PLEG): container finished" podID="4eb725e3-0a24-486f-9461-b9b8295b3dca" containerID="1d4b92525ce07dd3201e93bcbe36d18a06239b0404f53e6779df63cc8df2a6b3" exitCode=137
Oct 30 22:15:28.436617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.436583    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:15:28.436858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.436831    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" containerID="cri-o://86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d" gracePeriod=30
Oct 30 22:15:28.523894 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.523864    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:28.625799 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.625758    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\" (UniqueName: \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\") pod \"4eb725e3-0a24-486f-9461-b9b8295b3dca\" (UID: \"4eb725e3-0a24-486f-9461-b9b8295b3dca\") "
Oct 30 22:15:28.627923 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.627892    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x" pod "4eb725e3-0a24-486f-9461-b9b8295b3dca" (UID: "4eb725e3-0a24-486f-9461-b9b8295b3dca"). InnerVolumeSpecName "kube-api-access-rbs4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:28.728002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.727963    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbs4x\" (UniqueName: \"kubernetes.io/projected/4eb725e3-0a24-486f-9461-b9b8295b3dca-kube-api-access-rbs4x\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:28.957045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.957010    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:15:28.957290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:28.957262    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" containerID="cri-o://09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1" gracePeriod=30
Oct 30 22:15:29.146910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:29.146877    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" path="/var/lib/kubelet/pods/4eb725e3-0a24-486f-9461-b9b8295b3dca/volumes"
Oct 30 22:15:29.327665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:29.327581    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-c16680"
Oct 30 22:15:29.327665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:29.327637    5579 scope.go:122] "RemoveContainer" containerID="1d4b92525ce07dd3201e93bcbe36d18a06239b0404f53e6779df63cc8df2a6b3"
Oct 30 22:15:32.459264 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:32.459224    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:15:32.459748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:32.459285    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:15:33.380529 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.380498    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:15:33.380699 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.380548    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:15:33.702146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.702123    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:15:33.805545 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805512    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.805775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805578    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.805775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805623    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.805775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805679    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.805775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805719    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.805775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805754    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.806079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805832    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:33.806079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805883    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.806079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.805891    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:33.806079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806016    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.806282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806115    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:33.806282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806135    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:33.806282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806140    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\") pod \"7d6beb42-f658-4f07-ad24-85753d695b0a\" (UID: \"7d6beb42-f658-4f07-ad24-85753d695b0a\") "
Oct 30 22:15:33.806534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806496    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:33.806780 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806762    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.806858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806786    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d6beb42-f658-4f07-ad24-85753d695b0a-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.806858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806800    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.806858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806813    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.806858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.806826    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.808154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.808131    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:33.808154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.808143    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:33.808441 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.808413    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "kube-api-access-2ptq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:33.808441 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.808428    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token" pod "7d6beb42-f658-4f07-ad24-85753d695b0a" (UID: "7d6beb42-f658-4f07-ad24-85753d695b0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:33.908816 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.908780    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.908816 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.908811    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ptq6\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-kube-api-access-2ptq6\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.909063 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.908826    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:33.909063 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:33.908841    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d6beb42-f658-4f07-ad24-85753d695b0a-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.211828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.211802    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:15:34.315704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315621    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.315704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315662    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.315910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315785    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.315910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315831    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.315910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315880    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.316059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315957    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:34.316059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.315978    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.316059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316044    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.316221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316056    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:34.316221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316078    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.316221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316134    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:34.316221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316189    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\") pod \"370e75b3-1d66-4d22-86e0-25421b3fe79d\" (UID: \"370e75b3-1d66-4d22-86e0-25421b3fe79d\") "
Oct 30 22:15:34.316427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316301    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:34.316611 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316584    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:34.316782 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316758    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.316863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316789    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.316863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316805    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.316863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.316820    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.318119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.318093    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:34.318223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.318131    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:34.318223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.318160    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "kube-api-access-smhjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:34.318223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.318188    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo" pod "370e75b3-1d66-4d22-86e0-25421b3fe79d" (UID: "370e75b3-1d66-4d22-86e0-25421b3fe79d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:34.366609 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.366578    5579 generic.go:356] "Generic (PLEG): container finished" podID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerID="09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1" exitCode=0
Oct 30 22:15:34.366809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.366653    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"
Oct 30 22:15:34.366809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.366665    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" event={"ID":"370e75b3-1d66-4d22-86e0-25421b3fe79d","Type":"ContainerDied","Data":"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"}
Oct 30 22:15:34.366809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.366741    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz" event={"ID":"370e75b3-1d66-4d22-86e0-25421b3fe79d","Type":"ContainerDied","Data":"3cf0a42202e793df6d4500b94624e5f8d1ddaed3ab8885058391596bd572d1e2"}
Oct 30 22:15:34.366809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.366772    5579 scope.go:122] "RemoveContainer" containerID="09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"
Oct 30 22:15:34.368686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.368604    5579 generic.go:356] "Generic (PLEG): container finished" podID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerID="86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d" exitCode=0
Oct 30 22:15:34.368686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.368649    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" event={"ID":"7d6beb42-f658-4f07-ad24-85753d695b0a","Type":"ContainerDied","Data":"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"}
Oct 30 22:15:34.368843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.368684    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"
Oct 30 22:15:34.368843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.368690    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p" event={"ID":"7d6beb42-f658-4f07-ad24-85753d695b0a","Type":"ContainerDied","Data":"352952c2e869d13948963d519934803f7d537dff63b1e311f65d12945cd0b890"}
Oct 30 22:15:34.380321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.380043    5579 scope.go:122] "RemoveContainer" containerID="09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"
Oct 30 22:15:34.380393 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:34.380360    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1\": container with ID starting with 09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1 not found: ID does not exist" containerID="09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"
Oct 30 22:15:34.380448 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.380393    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1"} err="failed to get container status \"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1\": rpc error: code = NotFound desc = could not find container \"09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1\": container with ID starting with 09f4429d50d61a4a18d85a7afb30cb3158fe0a156eccb8a49fd188aa58d595e1 not found: ID does not exist"
Oct 30 22:15:34.380448 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.380416    5579 scope.go:122] "RemoveContainer" containerID="86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"
Oct 30 22:15:34.391518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.391501    5579 scope.go:122] "RemoveContainer" containerID="86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"
Oct 30 22:15:34.391781 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:34.391762    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d\": container with ID starting with 86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d not found: ID does not exist" containerID="86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"
Oct 30 22:15:34.391850 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.391790    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d"} err="failed to get container status \"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d\": rpc error: code = NotFound desc = could not find container \"86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d\": container with ID starting with 86b94d669efffb2fcb3544df861e055425a9407714bbc54c4aee37fbecc4dc4d not found: ID does not exist"
Oct 30 22:15:34.418486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.418462    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smhjq\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-kube-api-access-smhjq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.418581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.418489    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.418581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.418499    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/370e75b3-1d66-4d22-86e0-25421b3fe79d-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.418581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.418507    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.418581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.418516    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/370e75b3-1d66-4d22-86e0-25421b3fe79d-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:34.521824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.521795    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:15:34.525744 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.525718    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-c6fpz"]
Oct 30 22:15:34.631015 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.630909    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:15:34.636109 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:34.636075    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-psb7p"]
Oct 30 22:15:35.148800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.148762    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" path="/var/lib/kubelet/pods/370e75b3-1d66-4d22-86e0-25421b3fe79d/volumes"
Oct 30 22:15:35.149288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.149273    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" path="/var/lib/kubelet/pods/7d6beb42-f658-4f07-ad24-85753d695b0a/volumes"
Oct 30 22:15:35.373195 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.373163    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:15:35.373371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.373351    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerName="discovery" containerID="cri-o://9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866" gracePeriod=30
Oct 30 22:15:35.654527 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.654465    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:15:35.736635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736595    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.736830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736649    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.736830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736700    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.736830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736742    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.736830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736783    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.737088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736915    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.737088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.736983    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\") pod \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\" (UID: \"c5d6f0e5-d39f-46bb-83bf-9c95178988d8\") "
Oct 30 22:15:35.737294 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.737265    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:35.737708 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.737677    5579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-ca-configmap\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.739257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739184    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:15:35.739257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739225    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "kube-api-access-kr6v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:35.739441 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739410    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:35.739441 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739427    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:35.739547 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739444    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:15:35.739676 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.739662    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig" pod "c5d6f0e5-d39f-46bb-83bf-9c95178988d8" (UID: "c5d6f0e5-d39f-46bb-83bf-9c95178988d8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:15:35.839028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.838994    5579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-csr-dns-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.839028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.839022    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr6v8\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-kube-api-access-kr6v8\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.839230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.839056    5579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-local-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.839230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.839065    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.839230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.839075    5579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-cacerts\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:35.839230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:35.839083    5579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5d6f0e5-d39f-46bb-83bf-9c95178988d8-istio-kubeconfig\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:36.386675 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.386637    5579 generic.go:356] "Generic (PLEG): container finished" podID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerID="9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866" exitCode=0
Oct 30 22:15:36.387174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.386690    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"
Oct 30 22:15:36.387174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.386722    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" event={"ID":"c5d6f0e5-d39f-46bb-83bf-9c95178988d8","Type":"ContainerDied","Data":"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"}
Oct 30 22:15:36.387174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.386776    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx" event={"ID":"c5d6f0e5-d39f-46bb-83bf-9c95178988d8","Type":"ContainerDied","Data":"f48a8faf5a2b2419e652bc01dee55d0bd522acbe06582dd8a8eef09f683e528e"}
Oct 30 22:15:36.387174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.386798    5579 scope.go:122] "RemoveContainer" containerID="9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"
Oct 30 22:15:36.397305 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.397283    5579 scope.go:122] "RemoveContainer" containerID="9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"
Oct 30 22:15:36.397563 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:36.397544    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866\": container with ID starting with 9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866 not found: ID does not exist" containerID="9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"
Oct 30 22:15:36.397633 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.397577    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866"} err="failed to get container status \"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866\": rpc error: code = NotFound desc = could not find container \"9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866\": container with ID starting with 9ac34a3146b3585494ae9d87e99fe4d8de229f9d720bfb4957f2917d7a283866 not found: ID does not exist"
Oct 30 22:15:36.544674 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.544645    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:15:36.592708 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:36.592674    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q46lx"]
Oct 30 22:15:37.146597 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:37.146563    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" path="/var/lib/kubelet/pods/c5d6f0e5-d39f-46bb-83bf-9c95178988d8/volumes"
Oct 30 22:15:38.885998 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.885968    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:15:38.886725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886703    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886727    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce598c82-dce1-4baa-bacf-122d6169d243" containerName="cleanup"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886754    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" containerName="test-curl-7179-c16680"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886762    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" containerName="test-curl-7179-c16680"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886799    5579 cpu_manager.go:414] "containerMap: removing container" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886806    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886819    5579 cpu_manager.go:414] "containerMap: removing container" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy"
Oct 30 22:15:38.886832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886826    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886848    5579 cpu_manager.go:414] "containerMap: removing container" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerName="discovery"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.886856    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerName="discovery"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.887035    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5d6f0e5-d39f-46bb-83bf-9c95178988d8" containerName="discovery"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.887052    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="4eb725e3-0a24-486f-9461-b9b8295b3dca" containerName="test-curl-7179-c16680"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.887072    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="370e75b3-1d66-4d22-86e0-25421b3fe79d" containerName="istio-proxy"
Oct 30 22:15:38.887190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.887082    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d6beb42-f658-4f07-ad24-85753d695b0a" containerName="istio-proxy"
Oct 30 22:15:38.893110 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.893089    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:38.942005 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.941975    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c1f64a\""
Oct 30 22:15:38.989345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.989315    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c1f64a-dockercfg-frzjw\""
Oct 30 22:15:38.994043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:38.994012    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:15:39.035829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.035791    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:15:39.041200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.041175    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.080827 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.080781    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2s9\" (UniqueName: \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.081139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.080906    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.092169 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.092139    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:15:39.182480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.182392    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.182633 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.182571    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dwn\" (UniqueName: \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.182779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.182758    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2s9\" (UniqueName: \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.182855 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.182823    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.183285 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.183250    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.237199 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.237171    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2s9\" (UniqueName: \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\") pod \"payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.284781 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.284743    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.285110 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.285080    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dwn\" (UniqueName: \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.285518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.285498    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.339655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.339628    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dwn\" (UniqueName: \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\") pod \"payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.359496 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.359469    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:39.507558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.507464    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:39.734909 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.734853    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:15:39.740526 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:39.740500    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51df36e7_0dc3_45ea_bb54_bdb36ca162a0.slice/crio-ca9da3d14e70a36f0f8ecaa55b59b71da3470f26c292e52a40b26dbce704a870 WatchSource:0}: Error finding container ca9da3d14e70a36f0f8ecaa55b59b71da3470f26c292e52a40b26dbce704a870: Status 404 returned error can't find the container with id ca9da3d14e70a36f0f8ecaa55b59b71da3470f26c292e52a40b26dbce704a870
Oct 30 22:15:39.881158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:39.881125    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:15:39.885560 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:15:39.885535    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7005d5e1_ff98_4ead_add0_c753c9394c00.slice/crio-a67a459e5adb0a5075ff8964265f621c7eecb084660395808a0b2190596f5fa5 WatchSource:0}: Error finding container a67a459e5adb0a5075ff8964265f621c7eecb084660395808a0b2190596f5fa5: Status 404 returned error can't find the container with id a67a459e5adb0a5075ff8964265f621c7eecb084660395808a0b2190596f5fa5
Oct 30 22:15:40.415049 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.415015    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" event={"ID":"7005d5e1-ff98-4ead-add0-c753c9394c00","Type":"ContainerStarted","Data":"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"}
Oct 30 22:15:40.415493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.415066    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" event={"ID":"7005d5e1-ff98-4ead-add0-c753c9394c00","Type":"ContainerStarted","Data":"a67a459e5adb0a5075ff8964265f621c7eecb084660395808a0b2190596f5fa5"}
Oct 30 22:15:40.415493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.415140    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:40.416777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.416751    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" event={"ID":"51df36e7-0dc3-45ea-bb54-bdb36ca162a0","Type":"ContainerStarted","Data":"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"}
Oct 30 22:15:40.416908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.416799    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" event={"ID":"51df36e7-0dc3-45ea-bb54-bdb36ca162a0","Type":"ContainerStarted","Data":"ca9da3d14e70a36f0f8ecaa55b59b71da3470f26c292e52a40b26dbce704a870"}
Oct 30 22:15:40.416908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.416853    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:40.524857 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.524807    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" podStartSLOduration=2.524794779 podStartE2EDuration="2.524794779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:40.522072213 +0000 UTC m=+1945.491918634" watchObservedRunningTime="2026-10-30 22:15:40.524794779 +0000 UTC m=+1945.494641230"
Oct 30 22:15:40.629894 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:40.629844    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" podStartSLOduration=2.629830197 podStartE2EDuration="2.629830197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:40.629110076 +0000 UTC m=+1945.598956484" watchObservedRunningTime="2026-10-30 22:15:40.629830197 +0000 UTC m=+1945.599676606"
Oct 30 22:15:42.930010 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:42.929975    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:15:43.403130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:43.403084    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 22:15:43.403378 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:43.403347    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" containerID="cri-o://551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4" gracePeriod=30
Oct 30 22:15:45.313994 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:45.313954    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:15:45.314368 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:45.314031    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:15:48.694400 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.694375    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 22:15:48.804141 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804109    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804152    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804180    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804250    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804497 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804324    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804497 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804356    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804497 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804380    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804497 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804430    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:48.804701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804563    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804563    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:48.804701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804609    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\") pod \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\" (UID: \"3ce2dba9-6286-47d6-b53d-d41c3fbcea83\") "
Oct 30 22:15:48.804701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804684    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:48.804886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804791    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:48.804886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.804842    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:48.805225 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.805199    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.805329 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.805226    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.805329 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.805242    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.805329 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.805255    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.805329 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.805268    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.806588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.806563    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:48.806697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.806648    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:48.806697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.806683    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "kube-api-access-66k5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:48.806775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.806713    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy" pod "3ce2dba9-6286-47d6-b53d-d41c3fbcea83" (UID: "3ce2dba9-6286-47d6-b53d-d41c3fbcea83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:48.906976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.906944    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.906976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.906975    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66k5j\" (UniqueName: \"kubernetes.io/projected/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-kube-api-access-66k5j\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.907172 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.906986    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.907172 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:48.906995    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce2dba9-6286-47d6-b53d-d41c3fbcea83-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:15:49.481496 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.481361    5579 generic.go:356] "Generic (PLEG): container finished" podID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerID="551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4" exitCode=0
Oct 30 22:15:49.481496 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.481448    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"
Oct 30 22:15:49.481872 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.481833    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" event={"ID":"3ce2dba9-6286-47d6-b53d-d41c3fbcea83","Type":"ContainerDied","Data":"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"}
Oct 30 22:15:49.481995 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.481920    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg" event={"ID":"3ce2dba9-6286-47d6-b53d-d41c3fbcea83","Type":"ContainerDied","Data":"54c88859b5a1b9a4b867b2ed984f881f506ccfe630da240738e924a561207927"}
Oct 30 22:15:49.481995 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.481982    5579 scope.go:122] "RemoveContainer" containerID="551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"
Oct 30 22:15:49.492812 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.492785    5579 scope.go:122] "RemoveContainer" containerID="551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"
Oct 30 22:15:49.493155 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:15:49.493124    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4\": container with ID starting with 551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4 not found: ID does not exist" containerID="551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"
Oct 30 22:15:49.493250 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.493163    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4"} err="failed to get container status \"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4\": rpc error: code = NotFound desc = could not find container \"551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4\": container with ID starting with 551aef955877b16ac639a8c250a881d98d305f70e0df9efd304cc5aca2ba72a4 not found: ID does not exist"
Oct 30 22:15:49.654228 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.654193    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 22:15:49.662850 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:49.662808    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-brdwg"]
Oct 30 22:15:51.147258 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:51.147225    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" path="/var/lib/kubelet/pods/3ce2dba9-6286-47d6-b53d-d41c3fbcea83/volumes"
Oct 30 22:15:51.426883 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:51.426804    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:15:51.426883 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:51.426874    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:15:59.051283 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:59.051253    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:15:59.051704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:59.051468    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" containerID="cri-o://a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343" gracePeriod=30
Oct 30 22:15:59.202512 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:59.202478    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 22:15:59.202711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:15:59.202687    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" containerID="cri-o://f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af" gracePeriod=30
Oct 30 22:16:01.594453 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:01.594417    5579 patch_prober.go:29] interesting pod/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:16:01.594856 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:01.594472    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:16:02.009905 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:02.009866    5579 patch_prober.go:29] interesting pod/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:16:02.010094 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:02.009957    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:16:04.333779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.333754    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:16:04.419941 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.419884    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420009    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420097    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420193    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420246    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420276    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420313    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420414    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.420738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.420500    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\") pod \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\" (UID: \"a3090a44-d40c-433e-8c2a-2a0c99f1adfc\") "
Oct 30 22:16:04.421390 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.421362    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:04.422053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.421658    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.422053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.421746    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.422053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.421764    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.422053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.421886    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.424179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.424156    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "kube-api-access-jnh4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:04.424266 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.424252    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:04.424348 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.424333    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.424514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.424491    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token" pod "a3090a44-d40c-433e-8c2a-2a0c99f1adfc" (UID: "a3090a44-d40c-433e-8c2a-2a0c99f1adfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:04.461156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.461126    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 22:16:04.522554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522517    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522554    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522571    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522585    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnh4m\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-kube-api-access-jnh4m\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522601    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522615    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522628    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522641    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.522768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.522655    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3090a44-d40c-433e-8c2a-2a0c99f1adfc-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.579395 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.579309    5579 generic.go:356] "Generic (PLEG): container finished" podID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerID="a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343" exitCode=0
Oct 30 22:16:04.579395 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.579358    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"
Oct 30 22:16:04.579641 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.579402    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" event={"ID":"a3090a44-d40c-433e-8c2a-2a0c99f1adfc","Type":"ContainerDied","Data":"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"}
Oct 30 22:16:04.579641 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.579463    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl" event={"ID":"a3090a44-d40c-433e-8c2a-2a0c99f1adfc","Type":"ContainerDied","Data":"33c22ef33b83fa99a063f4fa67e314d4fd0608ba0fa74459d292e07a8a128ccf"}
Oct 30 22:16:04.579641 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.579493    5579 scope.go:122] "RemoveContainer" containerID="a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"
Oct 30 22:16:04.581018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.580921    5579 generic.go:356] "Generic (PLEG): container finished" podID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerID="f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af" exitCode=0
Oct 30 22:16:04.581018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.580991    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" event={"ID":"b83b1d40-32a5-462b-a805-5979e5b1d75f","Type":"ContainerDied","Data":"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"}
Oct 30 22:16:04.581194 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.581063    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v" event={"ID":"b83b1d40-32a5-462b-a805-5979e5b1d75f","Type":"ContainerDied","Data":"12d85ec809befd8b787c7b65fdab5b87f8b631c0e69254c2b15e18f2b8b10746"}
Oct 30 22:16:04.581194 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.581004    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"
Oct 30 22:16:04.590210 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.590196    5579 scope.go:122] "RemoveContainer" containerID="a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"
Oct 30 22:16:04.590487 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:04.590463    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343\": container with ID starting with a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343 not found: ID does not exist" containerID="a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"
Oct 30 22:16:04.590598 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.590491    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343"} err="failed to get container status \"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343\": rpc error: code = NotFound desc = could not find container \"a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343\": container with ID starting with a1febfe2daf8db2c2d1660dd963669f9ce6e4e681d5baaa8a9dfcb0800d15343 not found: ID does not exist"
Oct 30 22:16:04.590598 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.590505    5579 scope.go:122] "RemoveContainer" containerID="f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"
Oct 30 22:16:04.601986 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.600040    5579 scope.go:122] "RemoveContainer" containerID="f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"
Oct 30 22:16:04.601986 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:04.600384    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af\": container with ID starting with f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af not found: ID does not exist" containerID="f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"
Oct 30 22:16:04.601986 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.600416    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af"} err="failed to get container status \"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af\": rpc error: code = NotFound desc = could not find container \"f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af\": container with ID starting with f717fa2c9622abfc1440e170dcb898fd822bbb519cbc49e282b9c5095b9028af not found: ID does not exist"
Oct 30 22:16:04.623064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623032    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623251 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623114    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623251 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623200    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623251 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623233    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623301    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623337    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623411    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623459    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.623575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623485    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623496    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.623738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623605    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\") pod \"b83b1d40-32a5-462b-a805-5979e5b1d75f\" (UID: \"b83b1d40-32a5-462b-a805-5979e5b1d75f\") "
Oct 30 22:16:04.623738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.623703    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.624066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.624036    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.624066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.624065    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.624318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.624080    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.624318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.624288    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.624436 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.624389    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:04.625798 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.625775    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:04.625893 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.625826    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:04.626249 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.626223    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:04.626680 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.626655    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h" pod "b83b1d40-32a5-462b-a805-5979e5b1d75f" (UID: "b83b1d40-32a5-462b-a805-5979e5b1d75f"). InnerVolumeSpecName "kube-api-access-vwf8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:04.710811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.710773    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:16:04.715372 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.715344    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-14af5c-openshift-default-7c9d5d5d57-z9zdl"]
Oct 30 22:16:04.725816 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725784    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83b1d40-32a5-462b-a805-5979e5b1d75f-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.725977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725823    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.725977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725857    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.725977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725871    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwf8h\" (UniqueName: \"kubernetes.io/projected/b83b1d40-32a5-462b-a805-5979e5b1d75f-kube-api-access-vwf8h\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.725977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725887    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.725977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.725901    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83b1d40-32a5-462b-a805-5979e5b1d75f-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:04.996095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.996055    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 22:16:04.999830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:04.999791    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-vnf8v"]
Oct 30 22:16:05.149639 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:05.149548    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" path="/var/lib/kubelet/pods/a3090a44-d40c-433e-8c2a-2a0c99f1adfc/volumes"
Oct 30 22:16:05.150412 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:05.150386    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" path="/var/lib/kubelet/pods/b83b1d40-32a5-462b-a805-5979e5b1d75f/volumes"
Oct 30 22:16:12.185652 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:12.185603    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 22:16:12.194051 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:12.185968    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" containerID="cri-o://a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1" gracePeriod=30
Oct 30 22:16:12.929761 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:12.929722    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:16:17.349669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.349638    5579 patch_prober.go:29] interesting pod/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 22:16:17.350090 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.349716    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 22:16:17.468420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.468359    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 22:16:17.587532 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.587494    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.587709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.587575    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.587709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.587616    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.587709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.587677    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.587888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.587744    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.588030 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588006    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.588118 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588069    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:17.588190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588115    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.588190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588135    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:17.588190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588163    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.588344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588226    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\") pod \"7d0c3f1c-5e0e-4453-856e-615413854369\" (UID: \"7d0c3f1c-5e0e-4453-856e-615413854369\") "
Oct 30 22:16:17.588344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588278    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:17.588427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588367    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:17.588494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588016    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:17.588791 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588773    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d0c3f1c-5e0e-4453-856e-615413854369-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.588904 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588888    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.589011 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588906    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.589011 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588915    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.589011 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.588924    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.590287 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.590264    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:17.590392 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.590309    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:17.590711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.590691    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:17.590773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.590690    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46" pod "7d0c3f1c-5e0e-4453-856e-615413854369" (UID: "7d0c3f1c-5e0e-4453-856e-615413854369"). InnerVolumeSpecName "kube-api-access-78g46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:17.674081 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.674040    5579 generic.go:356] "Generic (PLEG): container finished" podID="7d0c3f1c-5e0e-4453-856e-615413854369" containerID="a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1" exitCode=0
Oct 30 22:16:17.674286 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.674102    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"
Oct 30 22:16:17.674286 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.674233    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" event={"ID":"7d0c3f1c-5e0e-4453-856e-615413854369","Type":"ContainerDied","Data":"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"}
Oct 30 22:16:17.674286 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.674276    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt" event={"ID":"7d0c3f1c-5e0e-4453-856e-615413854369","Type":"ContainerDied","Data":"a5bf7812630ce877e161b7d790fba1d22a9f640b526b9b468ef681bc6b1375cc"}
Oct 30 22:16:17.674473 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.674308    5579 scope.go:122] "RemoveContainer" containerID="a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"
Oct 30 22:16:17.690653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.690624    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78g46\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-kube-api-access-78g46\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.690779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.690655    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d0c3f1c-5e0e-4453-856e-615413854369-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.690779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.690670    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d0c3f1c-5e0e-4453-856e-615413854369-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.690779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.690700    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d0c3f1c-5e0e-4453-856e-615413854369-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:17.693018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.693000    5579 scope.go:122] "RemoveContainer" containerID="a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"
Oct 30 22:16:17.693319 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:17.693296    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1\": container with ID starting with a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1 not found: ID does not exist" containerID="a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"
Oct 30 22:16:17.693410 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.693328    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1"} err="failed to get container status \"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1\": rpc error: code = NotFound desc = could not find container \"a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1\": container with ID starting with a52804d589614c33f701efab16ea3c972147b7dda602c485216a19d51c6af7b1 not found: ID does not exist"
Oct 30 22:16:17.830772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.830686    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 22:16:17.836919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:17.836891    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-hxjvt"]
Oct 30 22:16:19.147880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:19.147849    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" path="/var/lib/kubelet/pods/7d0c3f1c-5e0e-4453-856e-615413854369/volumes"
Oct 30 22:16:32.594035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:32.593959    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:16:32.594443 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:32.594176    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" podUID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" containerName="maas-api" containerID="cri-o://da050ad59615d99e4aa6968388b20814bac98c7b87f3cd6fa394132ffaa5c7b0" gracePeriod=30
Oct 30 22:16:32.771461 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:32.771425    5579 generic.go:356] "Generic (PLEG): container finished" podID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" containerID="da050ad59615d99e4aa6968388b20814bac98c7b87f3cd6fa394132ffaa5c7b0" exitCode=0
Oct 30 22:16:32.771612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:32.771471    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" event={"ID":"4a85b8a6-8310-4bb4-9bda-2248ffae2011","Type":"ContainerDied","Data":"da050ad59615d99e4aa6968388b20814bac98c7b87f3cd6fa394132ffaa5c7b0"}
Oct 30 22:16:32.914826 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:32.914793    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:16:33.091219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.091190    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\") pod \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") "
Oct 30 22:16:33.091401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.091284    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\") pod \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") "
Oct 30 22:16:33.091489 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.091412    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\" (UniqueName: \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\") pod \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") "
Oct 30 22:16:33.091489 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.091471    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\") pod \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\" (UID: \"4a85b8a6-8310-4bb4-9bda-2248ffae2011\") "
Oct 30 22:16:33.091694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.091672    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca" pod "4a85b8a6-8310-4bb4-9bda-2248ffae2011" (UID: "4a85b8a6-8310-4bb4-9bda-2248ffae2011"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:33.092041 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.092019    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a85b8a6-8310-4bb4-9bda-2248ffae2011-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:33.093723 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.093668    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt" pod "4a85b8a6-8310-4bb4-9bda-2248ffae2011" (UID: "4a85b8a6-8310-4bb4-9bda-2248ffae2011"). InnerVolumeSpecName "kube-api-access-p6sxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:33.094033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.094005    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls" pod "4a85b8a6-8310-4bb4-9bda-2248ffae2011" (UID: "4a85b8a6-8310-4bb4-9bda-2248ffae2011"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:33.095028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.095011    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs" pod "4a85b8a6-8310-4bb4-9bda-2248ffae2011" (UID: "4a85b8a6-8310-4bb4-9bda-2248ffae2011"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:33.192963 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.192914    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6sxt\" (UniqueName: \"kubernetes.io/projected/4a85b8a6-8310-4bb4-9bda-2248ffae2011-kube-api-access-p6sxt\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:33.193128 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.192966    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:33.193128 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.192982    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a85b8a6-8310-4bb4-9bda-2248ffae2011-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:16:33.778947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.778909    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"
Oct 30 22:16:33.779387 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.778945    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk" event={"ID":"4a85b8a6-8310-4bb4-9bda-2248ffae2011","Type":"ContainerDied","Data":"88b0de10ab8f4d24feae34df9bafb3c6dc8581eb6db80999bf3a3ef38e2c6759"}
Oct 30 22:16:33.779387 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.779006    5579 scope.go:122] "RemoveContainer" containerID="da050ad59615d99e4aa6968388b20814bac98c7b87f3cd6fa394132ffaa5c7b0"
Oct 30 22:16:33.934420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.934388    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:16:33.940140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:33.940115    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-446040-74858cc7f-cpxrk"]
Oct 30 22:16:35.146120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:35.146087    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" path="/var/lib/kubelet/pods/4a85b8a6-8310-4bb4-9bda-2248ffae2011/volumes"
Oct 30 22:16:42.931217 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:42.931172    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:16:48.612055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612018    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:16:48.612655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612624    5579 cpu_manager.go:414] "containerMap: removing container" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy"
Oct 30 22:16:48.612655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612650    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612691    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612700    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612732    5579 cpu_manager.go:414] "containerMap: removing container" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612740    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612754    5579 cpu_manager.go:414] "containerMap: removing container" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612761    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612772    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" containerName="maas-api"
Oct 30 22:16:48.612824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612779    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" containerName="maas-api"
Oct 30 22:16:48.613096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612900    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3090a44-d40c-433e-8c2a-2a0c99f1adfc" containerName="istio-proxy"
Oct 30 22:16:48.613096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612909    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ce2dba9-6286-47d6-b53d-d41c3fbcea83" containerName="istio-proxy"
Oct 30 22:16:48.613096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612915    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a85b8a6-8310-4bb4-9bda-2248ffae2011" containerName="maas-api"
Oct 30 22:16:48.613096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612939    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="b83b1d40-32a5-462b-a805-5979e5b1d75f" containerName="istio-proxy"
Oct 30 22:16:48.613096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.612947    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d0c3f1c-5e0e-4453-856e-615413854369" containerName="istio-proxy"
Oct 30 22:16:48.616361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.616344    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.665125 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.665091    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0ce563-serving-cert\""
Oct 30 22:16:48.710918 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.710862    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.711118 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.710992    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.711299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.711276    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.711371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.711356    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2spc\" (UniqueName: \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.714620 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.714593    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:16:48.812721 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.812683    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.812905 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.812745    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2spc\" (UniqueName: \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.812905 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.812787    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.812905 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.812839    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.813103 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:48.812979    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-serving-cert: secret "maas-api-e2e-api-b-0ce563-serving-cert" not found
Oct 30 22:16:48.813103 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:16:48.813068    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls podName:3d3fa597-4805-4560-9ed1-e61476bfab60 nodeName:}" failed. No retries permitted until 2026-10-30 22:16:49.313046959 +0000 UTC m=+2014.282893346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls") pod "maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" (UID: "3d3fa597-4805-4560-9ed1-e61476bfab60") : secret "maas-api-e2e-api-b-0ce563-serving-cert" not found
Oct 30 22:16:48.813579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.813558    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.815114 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.815092    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:48.866988 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:48.866892    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2spc\" (UniqueName: \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:49.320330 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:49.320286    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:49.322760 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:49.322735    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") pod \"maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:49.532269 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:49.532232    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:49.912371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:49.912331    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:16:49.917531 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:16:49.917499    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3fa597_4805_4560_9ed1_e61476bfab60.slice/crio-af32f3b4fdf6c777671f1f4e7c3d2be3a169825a245a4a36c0c48700791eef98 WatchSource:0}: Error finding container af32f3b4fdf6c777671f1f4e7c3d2be3a169825a245a4a36c0c48700791eef98: Status 404 returned error can't find the container with id af32f3b4fdf6c777671f1f4e7c3d2be3a169825a245a4a36c0c48700791eef98
Oct 30 22:16:49.919034 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:49.919015    5579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:16:50.905448 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:50.905417    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" event={"ID":"3d3fa597-4805-4560-9ed1-e61476bfab60","Type":"ContainerStarted","Data":"af32f3b4fdf6c777671f1f4e7c3d2be3a169825a245a4a36c0c48700791eef98"}
Oct 30 22:16:51.913869 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:51.913832    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" event={"ID":"3d3fa597-4805-4560-9ed1-e61476bfab60","Type":"ContainerStarted","Data":"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"}
Oct 30 22:16:51.914326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:51.913976    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:16:52.039487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:52.039432    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" podStartSLOduration=3.14128659 podStartE2EDuration="4.039417053s" totalImagesPullingTime="898.130463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:52.037709498 +0000 UTC m=+2017.007555907" watchObservedRunningTime="2026-10-30 22:16:52.039417053 +0000 UTC m=+2017.009263462"
Oct 30 22:16:57.926261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:16:57.926232    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:17:03.160475 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.160441    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:17:03.164980 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.164954    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.187205 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.187174    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.187378 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.187237    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.187420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.187380    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q98t\" (UniqueName: \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.187455 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.187438    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.214299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.214261    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c1f64a-serving-cert\""
Oct 30 22:17:03.263374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.263336    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:17:03.288210 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.288166    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.288424 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.288260    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.288424 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:17:03.288374    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-serving-cert: secret "maas-api-e2e-inf-a-c1f64a-serving-cert" not found
Oct 30 22:17:03.288424 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.288380    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q98t\" (UniqueName: \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.288595 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:17:03.288432    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls podName:d64aec46-ae77-4b95-882d-7181f86ff258 nodeName:}" failed. No retries permitted until 2026-10-30 22:17:03.78841714 +0000 UTC m=+2028.758263528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls") pod "maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" (UID: "d64aec46-ae77-4b95-882d-7181f86ff258") : secret "maas-api-e2e-inf-a-c1f64a-serving-cert" not found
Oct 30 22:17:03.288595 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.288481    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.288945 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.288912    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.290851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.290827    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.346046 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.346004    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q98t\" (UniqueName: \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.794349 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.794308    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:03.796732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:03.796711    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") pod \"maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:04.079113 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:04.079031    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:04.451665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:04.451626    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:17:04.456746 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:17:04.456717    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64aec46_ae77_4b95_882d_7181f86ff258.slice/crio-d6cb7971896510aaec67effe3846705c1eeba9522cf326517a4e747dd1d8acae WatchSource:0}: Error finding container d6cb7971896510aaec67effe3846705c1eeba9522cf326517a4e747dd1d8acae: Status 404 returned error can't find the container with id d6cb7971896510aaec67effe3846705c1eeba9522cf326517a4e747dd1d8acae
Oct 30 22:17:05.007743 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:05.007703    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" event={"ID":"d64aec46-ae77-4b95-882d-7181f86ff258","Type":"ContainerStarted","Data":"d6cb7971896510aaec67effe3846705c1eeba9522cf326517a4e747dd1d8acae"}
Oct 30 22:17:06.018778 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:06.018737    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" event={"ID":"d64aec46-ae77-4b95-882d-7181f86ff258","Type":"ContainerStarted","Data":"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"}
Oct 30 22:17:06.019924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:06.019897    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:06.130773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:06.130718    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" podStartSLOduration=2.204594882 podStartE2EDuration="3.130705294s" totalImagesPullingTime="926.110412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:06.129292693 +0000 UTC m=+2031.099139101" watchObservedRunningTime="2026-10-30 22:17:06.130705294 +0000 UTC m=+2031.100551702"
Oct 30 22:17:12.931217 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:17:12.931181    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:17:13.043303 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:13.043272    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:17:42.932209 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:17:42.932107    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:17:44.318403 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:44.318366    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:17:44.318915 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:44.318580    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" containerID="cri-o://cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da" gracePeriod=30
Oct 30 22:17:48.052151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:48.052111    5579 patch_prober.go:29] interesting pod/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:17:48.052612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:48.052175    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:17:49.613395 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.613367    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:17:49.710179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710151    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710360 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710299    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710360 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710327    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710360 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710347    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710374    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710434    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710455    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710494    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710560    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\") pod \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\" (UID: \"1f4ab295-37f3-4f83-a94a-d29fb75f9e77\") "
Oct 30 22:17:49.710761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710633    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:49.710761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710706    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:49.710901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710756    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:49.710901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.710823    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:49.711116 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.711077    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:49.711261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.711186    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.711261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.711209    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.711261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.711223    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.711261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.711238    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.712635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.712614    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:49.712728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.712676    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:49.712808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.712786    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:49.712899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.712858    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd" pod "1f4ab295-37f3-4f83-a94a-d29fb75f9e77" (UID: "1f4ab295-37f3-4f83-a94a-d29fb75f9e77"). InnerVolumeSpecName "kube-api-access-g4mkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:49.828386 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.828339    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.828622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.828601    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.828894 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.828780    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mkd\" (UniqueName: \"kubernetes.io/projected/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-kube-api-access-g4mkd\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.829211 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.829186    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:49.829211 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:49.829212    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f4ab295-37f3-4f83-a94a-d29fb75f9e77-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:17:50.371458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.371425    5579 generic.go:356] "Generic (PLEG): container finished" podID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerID="cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da" exitCode=0
Oct 30 22:17:50.371668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.371480    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"
Oct 30 22:17:50.371668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.371517    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" event={"ID":"1f4ab295-37f3-4f83-a94a-d29fb75f9e77","Type":"ContainerDied","Data":"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"}
Oct 30 22:17:50.371668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.371579    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k" event={"ID":"1f4ab295-37f3-4f83-a94a-d29fb75f9e77","Type":"ContainerDied","Data":"8e2154b8c1738c68add0113ca8a3377a3e003e310a885a77813b8cc8857e2545"}
Oct 30 22:17:50.371668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.371605    5579 scope.go:122] "RemoveContainer" containerID="cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"
Oct 30 22:17:50.383431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.383408    5579 scope.go:122] "RemoveContainer" containerID="cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"
Oct 30 22:17:50.383696 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:17:50.383677    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da\": container with ID starting with cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da not found: ID does not exist" containerID="cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"
Oct 30 22:17:50.383747 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.383706    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da"} err="failed to get container status \"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da\": rpc error: code = NotFound desc = could not find container \"cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da\": container with ID starting with cc3903d600e91688ffad7c72c06fbfc64499f5e572fff7f873a9f23df92af3da not found: ID does not exist"
Oct 30 22:17:50.572610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.572578    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:17:50.619103 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:50.619072    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-17d809-openshift-default-5b676976ff-cjh2k"]
Oct 30 22:17:51.152323 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:17:51.152292    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" path="/var/lib/kubelet/pods/1f4ab295-37f3-4f83-a94a-d29fb75f9e77/volumes"
Oct 30 22:18:12.933333 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:12.933115    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:18:41.815367 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:41.815329    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:18:41.930128 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:41.930090    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:18:42.931368 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:42.931330    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:18:44.910229 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:44.910188    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 22:18:44.910729 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:44.910411    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy" containerID="cri-o://8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e" gracePeriod=30
Oct 30 22:18:44.956384 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:44.956347    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 22:18:44.956575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:44.956552    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy" containerID="cri-o://4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f" gracePeriod=30
Oct 30 22:18:46.815904 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:46.815857    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" podUID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" containerName="payload-processing" containerID="cri-o://3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca" gracePeriod=25
Oct 30 22:18:46.931155 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:46.931119    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" podUID="7005d5e1-ff98-4ead-add0-c753c9394c00" containerName="payload-pre-processing" containerID="cri-o://8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7" gracePeriod=25
Oct 30 22:18:47.092031 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.091998    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:18:47.161525 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.161494    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\" (UniqueName: \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\") pod \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") "
Oct 30 22:18:47.161709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.161673    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\") pod \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\" (UID: \"51df36e7-0dc3-45ea-bb54-bdb36ca162a0\") "
Oct 30 22:18:47.162116 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.162086    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume" pod "51df36e7-0dc3-45ea-bb54-bdb36ca162a0" (UID: "51df36e7-0dc3-45ea-bb54-bdb36ca162a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:47.164681 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.164654    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn" pod "51df36e7-0dc3-45ea-bb54-bdb36ca162a0" (UID: "51df36e7-0dc3-45ea-bb54-bdb36ca162a0"). InnerVolumeSpecName "kube-api-access-48dwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:47.193198 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.193176    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:18:47.263069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.263029    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\" (UniqueName: \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\") pod \"7005d5e1-ff98-4ead-add0-c753c9394c00\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") "
Oct 30 22:18:47.263263 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.263085    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\") pod \"7005d5e1-ff98-4ead-add0-c753c9394c00\" (UID: \"7005d5e1-ff98-4ead-add0-c753c9394c00\") "
Oct 30 22:18:47.263541 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.263514    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume" pod "7005d5e1-ff98-4ead-add0-c753c9394c00" (UID: "7005d5e1-ff98-4ead-add0-c753c9394c00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:47.263678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.263538    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48dwn\" (UniqueName: \"kubernetes.io/projected/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-kube-api-access-48dwn\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.263811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.263683    5579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51df36e7-0dc3-45ea-bb54-bdb36ca162a0-plugins-config-volume\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.265315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.265290    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9" pod "7005d5e1-ff98-4ead-add0-c753c9394c00" (UID: "7005d5e1-ff98-4ead-add0-c753c9394c00"). InnerVolumeSpecName "kube-api-access-bx2s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:47.364988 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.364882    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx2s9\" (UniqueName: \"kubernetes.io/projected/7005d5e1-ff98-4ead-add0-c753c9394c00-kube-api-access-bx2s9\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.364988 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.364917    5579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7005d5e1-ff98-4ead-add0-c753c9394c00-plugins-config-volume\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:47.791431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.791373    5579 generic.go:356] "Generic (PLEG): container finished" podID="7005d5e1-ff98-4ead-add0-c753c9394c00" containerID="8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7" exitCode=0
Oct 30 22:18:47.791780 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.791509    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"
Oct 30 22:18:47.792230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.791567    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" event={"ID":"7005d5e1-ff98-4ead-add0-c753c9394c00","Type":"ContainerDied","Data":"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"}
Oct 30 22:18:47.792868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.792268    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45" event={"ID":"7005d5e1-ff98-4ead-add0-c753c9394c00","Type":"ContainerDied","Data":"a67a459e5adb0a5075ff8964265f621c7eecb084660395808a0b2190596f5fa5"}
Oct 30 22:18:47.792868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.792310    5579 scope.go:122] "RemoveContainer" containerID="8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"
Oct 30 22:18:47.795957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.795916    5579 generic.go:356] "Generic (PLEG): container finished" podID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" containerID="3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca" exitCode=0
Oct 30 22:18:47.796079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.796011    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"
Oct 30 22:18:47.796136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.796106    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" event={"ID":"51df36e7-0dc3-45ea-bb54-bdb36ca162a0","Type":"ContainerDied","Data":"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"}
Oct 30 22:18:47.796187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.796147    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc" event={"ID":"51df36e7-0dc3-45ea-bb54-bdb36ca162a0","Type":"ContainerDied","Data":"ca9da3d14e70a36f0f8ecaa55b59b71da3470f26c292e52a40b26dbce704a870"}
Oct 30 22:18:47.804664 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.804604    5579 scope.go:122] "RemoveContainer" containerID="8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"
Oct 30 22:18:47.805149 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:47.804965    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7\": container with ID starting with 8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7 not found: ID does not exist" containerID="8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"
Oct 30 22:18:47.805149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.805005    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7"} err="failed to get container status \"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7\": rpc error: code = NotFound desc = could not find container \"8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7\": container with ID starting with 8bae2645f66bec029ece869c9f76ebea028bea81dc1dae10f284e6e61b49a3b7 not found: ID does not exist"
Oct 30 22:18:47.805149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.805022    5579 scope.go:122] "RemoveContainer" containerID="3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"
Oct 30 22:18:47.818297 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.818232    5579 scope.go:122] "RemoveContainer" containerID="3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"
Oct 30 22:18:47.818745 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:47.818700    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca\": container with ID starting with 3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca not found: ID does not exist" containerID="3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"
Oct 30 22:18:47.818837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.818742    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca"} err="failed to get container status \"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca\": rpc error: code = NotFound desc = could not find container \"3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca\": container with ID starting with 3ab0b3028fdca43f3a03bb51036fad0495f0548f46038b95afe1f323d1ec96ca not found: ID does not exist"
Oct 30 22:18:47.950030 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.949999    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:18:47.957176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:47.957146    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c1f64a-9cdd9bf75-znr45"]
Oct 30 22:18:48.060331 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:48.060245    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:18:48.063288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:48.063259    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c1f64a-85f94d9ccd-dwgmc"]
Oct 30 22:18:49.147481 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:49.147438    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" path="/var/lib/kubelet/pods/51df36e7-0dc3-45ea-bb54-bdb36ca162a0/volumes"
Oct 30 22:18:49.148089 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:49.148069    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7005d5e1-ff98-4ead-add0-c753c9394c00" path="/var/lib/kubelet/pods/7005d5e1-ff98-4ead-add0-c753c9394c00/volumes"
Oct 30 22:18:50.190436 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.190370    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 22:18:50.216084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.216057    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 22:18:50.301264 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301225    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.301264 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301268    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.301491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301303    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.301491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301334    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.301491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301365    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.301491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301426    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.301491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301465    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.301768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301493    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.301768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301581    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.301768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301615    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.301768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301646    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301775    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301781    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301816    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301850    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301855    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:50.302010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.301916    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302037    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302096    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302150    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302188    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\") pod \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\" (UID: \"5f1a9bed-57e0-465c-9260-0ddc30ced7e1\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302036    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302228    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302264    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.302388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.302304    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\") pod \"06942da6-66eb-4de2-b3bb-21d505fb8732\" (UID: \"06942da6-66eb-4de2-b3bb-21d505fb8732\") "
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303029    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303056    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303072    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303089    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303105    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06942da6-66eb-4de2-b3bb-21d505fb8732-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303122    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303137    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.303651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303443    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:50.304013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303845    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.304013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.303913    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.304491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.304467    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:50.304587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.304504    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "kube-api-access-5z8p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:50.304587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.304567    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.304712 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.304650    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:18:50.305634 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.305612    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:18:50.305759 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.305743    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo" pod "5f1a9bed-57e0-465c-9260-0ddc30ced7e1" (UID: "5f1a9bed-57e0-465c-9260-0ddc30ced7e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:18:50.306265 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.306250    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "kube-api-access-b9nkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:50.306361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.306347    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token" pod "06942da6-66eb-4de2-b3bb-21d505fb8732" (UID: "06942da6-66eb-4de2-b3bb-21d505fb8732"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:50.404742 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404709    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.404742 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404739    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.404742 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404750    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404760    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404769    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404778    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9nkv\" (UniqueName: \"kubernetes.io/projected/06942da6-66eb-4de2-b3bb-21d505fb8732-kube-api-access-b9nkv\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404786    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06942da6-66eb-4de2-b3bb-21d505fb8732-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404795    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z8p2\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-kube-api-access-5z8p2\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404803    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404811    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.405017 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.404820    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1a9bed-57e0-465c-9260-0ddc30ced7e1-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:18:50.818908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.818868    5579 generic.go:356] "Generic (PLEG): container finished" podID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerID="4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f" exitCode=0
Oct 30 22:18:50.819105 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.818917    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"
Oct 30 22:18:50.819105 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.818953    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" event={"ID":"5f1a9bed-57e0-465c-9260-0ddc30ced7e1","Type":"ContainerDied","Data":"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"}
Oct 30 22:18:50.819105 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.819017    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg" event={"ID":"5f1a9bed-57e0-465c-9260-0ddc30ced7e1","Type":"ContainerDied","Data":"40f69ec20450f984dc639c2c5b6bfbb06c2fd3b4defc53901603e595a93045bb"}
Oct 30 22:18:50.819105 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.819050    5579 scope.go:122] "RemoveContainer" containerID="4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"
Oct 30 22:18:50.820610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.820587    5579 generic.go:356] "Generic (PLEG): container finished" podID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerID="8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e" exitCode=0
Oct 30 22:18:50.820720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.820635    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"
Oct 30 22:18:50.820720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.820695    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" event={"ID":"06942da6-66eb-4de2-b3bb-21d505fb8732","Type":"ContainerDied","Data":"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"}
Oct 30 22:18:50.820832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.820756    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2" event={"ID":"06942da6-66eb-4de2-b3bb-21d505fb8732","Type":"ContainerDied","Data":"eb1a9f7f27ca8f8fd13d7196dc97d31a7e632d54291863f7bad347af3598201d"}
Oct 30 22:18:50.830280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.830164    5579 scope.go:122] "RemoveContainer" containerID="4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"
Oct 30 22:18:50.830501 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:50.830482    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f\": container with ID starting with 4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f not found: ID does not exist" containerID="4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"
Oct 30 22:18:50.830581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.830512    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f"} err="failed to get container status \"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f\": rpc error: code = NotFound desc = could not find container \"4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f\": container with ID starting with 4c37dfc3d086d24e1aed138c1d6662f9603232c37c808fdf77dcdfdbf8ab0b6f not found: ID does not exist"
Oct 30 22:18:50.830581 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.830528    5579 scope.go:122] "RemoveContainer" containerID="8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"
Oct 30 22:18:50.839721 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.839696    5579 scope.go:122] "RemoveContainer" containerID="8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"
Oct 30 22:18:50.839990 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:18:50.839971    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e\": container with ID starting with 8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e not found: ID does not exist" containerID="8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"
Oct 30 22:18:50.840054 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.839998    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e"} err="failed to get container status \"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e\": rpc error: code = NotFound desc = could not find container \"8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e\": container with ID starting with 8e445dd76647a10351c7a4904e41ba90f98dbf4be0cd0e3859b3c0efa0293d7e not found: ID does not exist"
Oct 30 22:18:50.977846 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:50.977807    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 22:18:51.024281 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:51.024242    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zwwt2"]
Oct 30 22:18:51.087916 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:51.087831    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 22:18:51.092091 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:51.092059    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxmhg"]
Oct 30 22:18:51.147304 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:51.147273    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" path="/var/lib/kubelet/pods/06942da6-66eb-4de2-b3bb-21d505fb8732/volumes"
Oct 30 22:18:51.147759 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:18:51.147745    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" path="/var/lib/kubelet/pods/5f1a9bed-57e0-465c-9260-0ddc30ced7e1/volumes"
Oct 30 22:19:12.932483 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:12.932440    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:19:30.273501 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:30.273413    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:19:30.274023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:30.273651    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" containerID="cri-o://384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11" gracePeriod=30
Oct 30 22:19:33.774741 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:33.774707    5579 patch_prober.go:29] interesting pod/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:19:33.775194 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:33.774772    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:19:34.842326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842293    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:19:34.842923 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842895    5579 cpu_manager.go:414] "containerMap: removing container" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy"
Oct 30 22:19:34.842923 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842915    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy"
Oct 30 22:19:34.842923 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842940    5579 cpu_manager.go:414] "containerMap: removing container" podUID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" containerName="payload-processing"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842946    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" containerName="payload-processing"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842971    5579 cpu_manager.go:414] "containerMap: removing container" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842976    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842990    5579 cpu_manager.go:414] "containerMap: removing container" podUID="7005d5e1-ff98-4ead-add0-c753c9394c00" containerName="payload-pre-processing"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.842997    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7005d5e1-ff98-4ead-add0-c753c9394c00" containerName="payload-pre-processing"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843013    5579 cpu_manager.go:414] "containerMap: removing container" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy"
Oct 30 22:19:34.843174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843018    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy"
Oct 30 22:19:34.843718 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843695    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f1a9bed-57e0-465c-9260-0ddc30ced7e1" containerName="istio-proxy"
Oct 30 22:19:34.843904 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843884    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="51df36e7-0dc3-45ea-bb54-bdb36ca162a0" containerName="payload-processing"
Oct 30 22:19:34.844018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843906    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f4ab295-37f3-4f83-a94a-d29fb75f9e77" containerName="istio-proxy"
Oct 30 22:19:34.844018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843942    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="7005d5e1-ff98-4ead-add0-c753c9394c00" containerName="payload-pre-processing"
Oct 30 22:19:34.844018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.843955    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="06942da6-66eb-4de2-b3bb-21d505fb8732" containerName="istio-proxy"
Oct 30 22:19:34.851970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.851922    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:34.942594 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.942557    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:34.942764 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.942671    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djdf7\" (UniqueName: \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:34.942764 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.942751    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:34.942882 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.942857    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:34.950227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.950197    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3aa85e-serving-cert\""
Oct 30 22:19:34.953195 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:34.953158    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:19:35.043966 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.043912    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.044154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.044024    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djdf7\" (UniqueName: \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.044154 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.044082    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.044285 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.044174    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.044333 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:35.044311    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-serving-cert: secret "maas-api-e2e-inf-a-3aa85e-serving-cert" not found
Oct 30 22:19:35.044390 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:35.044378    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls podName:ad813560-0470-4e57-be06-61336ac24fa8 nodeName:}" failed. No retries permitted until 2026-10-30 22:19:35.544356534 +0000 UTC m=+2180.514202939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls") pod "maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" (UID: "ad813560-0470-4e57-be06-61336ac24fa8") : secret "maas-api-e2e-inf-a-3aa85e-serving-cert" not found
Oct 30 22:19:35.044737 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.044718    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.046796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.046772    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.098539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.098460    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djdf7\" (UniqueName: \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.542861 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.542832    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:19:35.551271 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.551238    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.553708 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.553680    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") pod \"maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:35.652405 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652301    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652405 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652402    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652438    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652498    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652534    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652574    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652605    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652647    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652734    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\") pod \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\" (UID: \"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7\") "
Oct 30 22:19:35.652953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652773    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:35.652953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.652793    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:35.653218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653168    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:35.653218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653190    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:35.653218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653200    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:35.653528 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653506    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.653681 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653665    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.653763 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653685    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.653763 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653699    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.653763 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.653712    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.655055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.655034    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:35.655439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.655418    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:19:35.655526 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.655448    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "kube-api-access-nz4nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:35.655526 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.655469    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token" pod "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" (UID: "c7412c11-804f-4d2f-b7ec-2c5508a5ddb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:35.755037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.755003    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz4nw\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-kube-api-access-nz4nw\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.755037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.755036    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.755235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.755048    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.755235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.755061    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:35.767401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:35.767365    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:36.143412 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.143375    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:19:36.147807 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.147777    5579 generic.go:356] "Generic (PLEG): container finished" podID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerID="384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11" exitCode=0
Oct 30 22:19:36.147970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.147818    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"
Oct 30 22:19:36.147970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.147864    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" event={"ID":"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7","Type":"ContainerDied","Data":"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"}
Oct 30 22:19:36.147970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.147950    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb" event={"ID":"c7412c11-804f-4d2f-b7ec-2c5508a5ddb7","Type":"ContainerDied","Data":"a343a273b7fedbd6eee205d2cdeac0ed4c302477fe0f2cd972b02d66ad730d99"}
Oct 30 22:19:36.148139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.147986    5579 scope.go:122] "RemoveContainer" containerID="384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"
Oct 30 22:19:36.167025 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.166900    5579 scope.go:122] "RemoveContainer" containerID="384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"
Oct 30 22:19:36.168019 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:36.167989    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11\": container with ID starting with 384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11 not found: ID does not exist" containerID="384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"
Oct 30 22:19:36.168122 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.168030    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11"} err="failed to get container status \"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11\": rpc error: code = NotFound desc = could not find container \"384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11\": container with ID starting with 384b1bd7322726e3b4636cbdf164724c959d1beb9b1ad7e014be69cad8edfb11 not found: ID does not exist"
Oct 30 22:19:36.303058 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.303012    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:19:36.349444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:36.349353    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5be0d1-openshift-default-55cd484f99-7znrb"]
Oct 30 22:19:37.147163 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:37.147131    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" path="/var/lib/kubelet/pods/c7412c11-804f-4d2f-b7ec-2c5508a5ddb7/volumes"
Oct 30 22:19:37.157188 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:37.157153    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" event={"ID":"ad813560-0470-4e57-be06-61336ac24fa8","Type":"ContainerStarted","Data":"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"}
Oct 30 22:19:37.157378 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:37.157213    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" event={"ID":"ad813560-0470-4e57-be06-61336ac24fa8","Type":"ContainerStarted","Data":"05d9a2781f2ccf5ccc011406118d35d1d0a99a1db57974b0961b9f39e02da3fc"}
Oct 30 22:19:37.157446 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:37.157378    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:37.289103 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:37.289044    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" podStartSLOduration=2.384327302 podStartE2EDuration="3.289023101s" totalImagesPullingTime="904.695799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:37.286429692 +0000 UTC m=+2182.256276100" watchObservedRunningTime="2026-10-30 22:19:37.289023101 +0000 UTC m=+2182.258869511"
Oct 30 22:19:42.931854 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:42.931816    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:19:43.169351 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.169320    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:19:43.484029 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.483991    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:19:43.484227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.484187    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" podUID="d64aec46-ae77-4b95-882d-7181f86ff258" containerName="maas-api" containerID="cri-o://1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7" gracePeriod=30
Oct 30 22:19:43.762207 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.762168    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:19:43.851848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.851792    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\") pod \"d64aec46-ae77-4b95-882d-7181f86ff258\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") "
Oct 30 22:19:43.852084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.851983    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") pod \"d64aec46-ae77-4b95-882d-7181f86ff258\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") "
Oct 30 22:19:43.852145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.852102    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\" (UniqueName: \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\") pod \"d64aec46-ae77-4b95-882d-7181f86ff258\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") "
Oct 30 22:19:43.852249 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.852231    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\") pod \"d64aec46-ae77-4b95-882d-7181f86ff258\" (UID: \"d64aec46-ae77-4b95-882d-7181f86ff258\") "
Oct 30 22:19:43.853997 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.853379    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca" pod "d64aec46-ae77-4b95-882d-7181f86ff258" (UID: "d64aec46-ae77-4b95-882d-7181f86ff258"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:43.859299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.859242    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs" pod "d64aec46-ae77-4b95-882d-7181f86ff258" (UID: "d64aec46-ae77-4b95-882d-7181f86ff258"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:19:43.861316 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.861262    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t" pod "d64aec46-ae77-4b95-882d-7181f86ff258" (UID: "d64aec46-ae77-4b95-882d-7181f86ff258"). InnerVolumeSpecName "kube-api-access-8q98t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:43.864116 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.864082    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls" pod "d64aec46-ae77-4b95-882d-7181f86ff258" (UID: "d64aec46-ae77-4b95-882d-7181f86ff258"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:19:43.953623 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.953582    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:43.953623 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.953616    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q98t\" (UniqueName: \"kubernetes.io/projected/d64aec46-ae77-4b95-882d-7181f86ff258-kube-api-access-8q98t\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:43.953623 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.953628    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d64aec46-ae77-4b95-882d-7181f86ff258-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:43.954220 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:43.953639    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d64aec46-ae77-4b95-882d-7181f86ff258-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:19:44.208872 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.208834    5579 generic.go:356] "Generic (PLEG): container finished" podID="d64aec46-ae77-4b95-882d-7181f86ff258" containerID="1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7" exitCode=0
Oct 30 22:19:44.209095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.208878    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"
Oct 30 22:19:44.209095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.208914    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" event={"ID":"d64aec46-ae77-4b95-882d-7181f86ff258","Type":"ContainerDied","Data":"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"}
Oct 30 22:19:44.209095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.209001    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz" event={"ID":"d64aec46-ae77-4b95-882d-7181f86ff258","Type":"ContainerDied","Data":"d6cb7971896510aaec67effe3846705c1eeba9522cf326517a4e747dd1d8acae"}
Oct 30 22:19:44.209095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.209024    5579 scope.go:122] "RemoveContainer" containerID="1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"
Oct 30 22:19:44.219797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.219775    5579 scope.go:122] "RemoveContainer" containerID="1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"
Oct 30 22:19:44.220136 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:19:44.220115    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7\": container with ID starting with 1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7 not found: ID does not exist" containerID="1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"
Oct 30 22:19:44.220207 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.220146    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7"} err="failed to get container status \"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7\": rpc error: code = NotFound desc = could not find container \"1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7\": container with ID starting with 1e96d84bd396a2127e9aae60f6751ed1e569720e7792318d2ea31699d524fbc7 not found: ID does not exist"
Oct 30 22:19:44.366805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.366275    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:19:44.383386 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:44.383333    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c1f64a-85bf99f487-rr5kz"]
Oct 30 22:19:45.147148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:19:45.147115    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d64aec46-ae77-4b95-882d-7181f86ff258" path="/var/lib/kubelet/pods/d64aec46-ae77-4b95-882d-7181f86ff258/volumes"
Oct 30 22:20:00.520672 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.520639    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:20:00.521227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521178    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d64aec46-ae77-4b95-882d-7181f86ff258" containerName="maas-api"
Oct 30 22:20:00.521227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521191    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d64aec46-ae77-4b95-882d-7181f86ff258" containerName="maas-api"
Oct 30 22:20:00.521227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521223    5579 cpu_manager.go:414] "containerMap: removing container" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy"
Oct 30 22:20:00.521227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521229    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy"
Oct 30 22:20:00.521358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521308    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="d64aec46-ae77-4b95-882d-7181f86ff258" containerName="maas-api"
Oct 30 22:20:00.521358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.521319    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7412c11-804f-4d2f-b7ec-2c5508a5ddb7" containerName="istio-proxy"
Oct 30 22:20:00.531649 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.531625    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543606 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543579    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543722 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543619    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543792 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543769    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543813    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543853    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sfwd\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543918 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543903    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.543987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543965    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.544024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.543997    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.544024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.544015    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645402 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645358    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645420    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645562    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645606    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645640    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sfwd\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645711    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645743    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645788    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645808    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.645899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.645820    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.646174 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.646097    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.646234 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.646183    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.646291 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.646269    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.646706 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.646686    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.648856 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.648832    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.651523 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.649020    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.700420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.700384    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.700907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.700885    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sfwd\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\") pod \"maas-default-gateway-openshift-default-694db55c87-c8m6p\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:00.741988 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.740965    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:20:00.846193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:00.846102    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:01.276940 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:01.276905    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:20:01.318740 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:01.318707    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4653cd_d8e5_49dd_9706_b1152bbdb89f.slice/crio-2b38ac88b3d7bfe0c7823467863fb35de0baa928eef4cae22474ee16e6b26487 WatchSource:0}: Error finding container 2b38ac88b3d7bfe0c7823467863fb35de0baa928eef4cae22474ee16e6b26487: Status 404 returned error can't find the container with id 2b38ac88b3d7bfe0c7823467863fb35de0baa928eef4cae22474ee16e6b26487
Oct 30 22:20:01.321228 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:01.321195    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:01.321326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:01.321272    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:01.321326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:01.321303    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:02.319574 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.319538    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" event={"ID":"2d4653cd-d8e5-49dd-9706-b1152bbdb89f","Type":"ContainerStarted","Data":"74dd6f50d0898ba226430a81efd7527b1cc05d24139a065d3c76a0b50a5416e4"}
Oct 30 22:20:02.320007 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.319601    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" event={"ID":"2d4653cd-d8e5-49dd-9706-b1152bbdb89f","Type":"ContainerStarted","Data":"2b38ac88b3d7bfe0c7823467863fb35de0baa928eef4cae22474ee16e6b26487"}
Oct 30 22:20:02.476767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.476713    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podStartSLOduration=2.4766999419999998 podStartE2EDuration="2.476699942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:02.475105478 +0000 UTC m=+2207.444951887" watchObservedRunningTime="2026-10-30 22:20:02.476699942 +0000 UTC m=+2207.446546351"
Oct 30 22:20:02.847954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.847340    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:02.848660 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.848627    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:02.848732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:02.848697    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:03.847518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:03.847437    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:03.847518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:03.847509    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:04.847373 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:04.847333    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:04.847690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:04.847657    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:05.849338 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:05.849297    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:05.849960 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:05.849905    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:06.847480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:06.847440    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:06.847798 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:06.847768    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:07.847405 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:07.847363    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:07.847907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:07.847425    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:08.847290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:08.847245    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:20:08.847463 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:08.847305    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": dial tcp 10.134.0.110:15021: connect: connection refused"
Oct 30 22:20:10.132678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:10.132640    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:10.133423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:10.133391    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:10.134160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:10.134139    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:20:12.940592 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:12.940458    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:20:15.622160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.622117    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:20:15.626352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.626328    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.742566 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.742532    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:20:15.748053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748019    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748069    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748267    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748369 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748353    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748382    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748422    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748533 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748474    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748533 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748516    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.748638 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.748541    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhz8\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849336    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849385    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849407    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhz8\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849445    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849464    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849554 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849507    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849564    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849591    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849628    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.849828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.849801    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.850235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.850209    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.850333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.850245    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.850333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.850209    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.850407 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.850364    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.851875 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.851852    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.852262 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.852245    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.906032 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.905996    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.906227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.906204    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhz8\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\") pod \"maas-default-gateway-openshift-default-694db55c87-d5zq7\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:15.941013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:15.940977    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:16.374133 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.374040    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:20:16.378892 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:16.378859    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ecfd70_c6c4_4bba_b695_d013bccf375e.slice/crio-20a9fd7e25a26c8d057e178549cdbf61ca0adb9818efd55871fc54f2ad736149 WatchSource:0}: Error finding container 20a9fd7e25a26c8d057e178549cdbf61ca0adb9818efd55871fc54f2ad736149: Status 404 returned error can't find the container with id 20a9fd7e25a26c8d057e178549cdbf61ca0adb9818efd55871fc54f2ad736149
Oct 30 22:20:16.381684 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.381646    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:16.381786 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.381719    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:16.381786 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.381756    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:16.465363 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.465331    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" event={"ID":"35ecfd70-c6c4-4bba-b695-d013bccf375e","Type":"ContainerStarted","Data":"fa079b25747c388395b54f3249d8c87d00e97ac5923d2c70980970c9fe271c0d"}
Oct 30 22:20:16.465494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.465414    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" event={"ID":"35ecfd70-c6c4-4bba-b695-d013bccf375e","Type":"ContainerStarted","Data":"20a9fd7e25a26c8d057e178549cdbf61ca0adb9818efd55871fc54f2ad736149"}
Oct 30 22:20:16.580306 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.580251    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podStartSLOduration=1.5802378240000001 podStartE2EDuration="1.580237824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:16.579284062 +0000 UTC m=+2221.549130472" watchObservedRunningTime="2026-10-30 22:20:16.580237824 +0000 UTC m=+2221.550084232"
Oct 30 22:20:16.941151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:16.941113    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:17.948892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:17.948861    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:17.949390 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:17.948912    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:18.942379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:18.942336    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:18.942698 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:18.942668    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:19.945115 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:19.945062    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:19.945719 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:19.945687    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:20.945447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:20.945408    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:20.946487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:20.946073    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:21.943952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:21.943336    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:21.943952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:21.943403    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:22.941560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:22.941522    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:22.941974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:22.941591    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:23.941788 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:23.941750    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:23.942201 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:23.941820    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": dial tcp 10.134.0.111:15021: connect: connection refused"
Oct 30 22:20:24.946383 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:24.946353    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:24.946795 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:24.946774    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:24.947456 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:24.947438    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:20:25.571669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.571633    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:20:25.576863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.576838    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.578469 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.578444    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.578599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.578530    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztqs7\" (UniqueName: \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.578673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.578597    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.578839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.578819    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.625728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.625694    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-edf6d5-serving-cert\""
Oct 30 22:20:25.676126 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.676089    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:20:25.679693 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.679662    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztqs7\" (UniqueName: \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.679858 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.679704    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.679858 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:25.679846    5579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-serving-cert: secret "maas-api-e2e-api-a-edf6d5-serving-cert" not found
Oct 30 22:20:25.680023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.679891    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.680023 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:25.679918    5579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls podName:cb2a2111-4f1f-43bc-a5e4-931b2b921c71 nodeName:}" failed. No retries permitted until 2026-10-30 22:20:26.179897406 +0000 UTC m=+2231.149743801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls") pod "maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" (UID: "cb2a2111-4f1f-43bc-a5e4-931b2b921c71") : secret "maas-api-e2e-api-a-edf6d5-serving-cert" not found
Oct 30 22:20:25.680203 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.680076    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.680658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.680637    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.682918 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.682898    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:25.734280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:25.734246    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztqs7\" (UniqueName: \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:26.186687 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:26.186653    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:26.189213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:26.189184    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") pod \"maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:26.199990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:26.199964    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:26.571344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:26.571260    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:20:26.577286 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:26.577255    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2a2111_4f1f_43bc_a5e4_931b2b921c71.slice/crio-f7a7ce75e7e96fda2013933ab0b0b7726e3d1c1ccfb3b06f425a10cd4facfae3 WatchSource:0}: Error finding container f7a7ce75e7e96fda2013933ab0b0b7726e3d1c1ccfb3b06f425a10cd4facfae3: Status 404 returned error can't find the container with id f7a7ce75e7e96fda2013933ab0b0b7726e3d1c1ccfb3b06f425a10cd4facfae3
Oct 30 22:20:27.546328 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:27.546296    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" event={"ID":"cb2a2111-4f1f-43bc-a5e4-931b2b921c71","Type":"ContainerStarted","Data":"f7a7ce75e7e96fda2013933ab0b0b7726e3d1c1ccfb3b06f425a10cd4facfae3"}
Oct 30 22:20:28.553524 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:28.553490    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" event={"ID":"cb2a2111-4f1f-43bc-a5e4-931b2b921c71","Type":"ContainerStarted","Data":"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"}
Oct 30 22:20:28.553966 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:28.553595    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:28.677504 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:28.677442    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" podStartSLOduration=2.7387231119999997 podStartE2EDuration="3.677424997s" totalImagesPullingTime="938.701885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:28.672662633 +0000 UTC m=+2233.642509066" watchObservedRunningTime="2026-10-30 22:20:28.677424997 +0000 UTC m=+2233.647271406"
Oct 30 22:20:30.086111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.086078    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:20:30.086522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.086281    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" podUID="c86b9208-11fe-431e-9072-efc30a2ede19" containerName="maas-api" containerID="cri-o://a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b" gracePeriod=30
Oct 30 22:20:30.401426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.401398    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:20:30.438368 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.438330    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\") pod \"c86b9208-11fe-431e-9072-efc30a2ede19\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") "
Oct 30 22:20:30.438534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.438382    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") pod \"c86b9208-11fe-431e-9072-efc30a2ede19\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") "
Oct 30 22:20:30.438534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.438414    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\" (UniqueName: \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\") pod \"c86b9208-11fe-431e-9072-efc30a2ede19\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") "
Oct 30 22:20:30.438534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.438451    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\") pod \"c86b9208-11fe-431e-9072-efc30a2ede19\" (UID: \"c86b9208-11fe-431e-9072-efc30a2ede19\") "
Oct 30 22:20:30.438944 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.438902    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca" pod "c86b9208-11fe-431e-9072-efc30a2ede19" (UID: "c86b9208-11fe-431e-9072-efc30a2ede19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:30.440803 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.440768    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls" pod "c86b9208-11fe-431e-9072-efc30a2ede19" (UID: "c86b9208-11fe-431e-9072-efc30a2ede19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:20:30.441084 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.441055    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr" pod "c86b9208-11fe-431e-9072-efc30a2ede19" (UID: "c86b9208-11fe-431e-9072-efc30a2ede19"). InnerVolumeSpecName "kube-api-access-pzlwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:30.441173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.441102    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs" pod "c86b9208-11fe-431e-9072-efc30a2ede19" (UID: "c86b9208-11fe-431e-9072-efc30a2ede19"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:20:30.540835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.540796    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:20:30.541131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.541111    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86b9208-11fe-431e-9072-efc30a2ede19-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:20:30.541253 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.541238    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzlwr\" (UniqueName: \"kubernetes.io/projected/c86b9208-11fe-431e-9072-efc30a2ede19-kube-api-access-pzlwr\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:20:30.541356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.541343    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86b9208-11fe-431e-9072-efc30a2ede19-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:20:30.571751 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.571705    5579 generic.go:356] "Generic (PLEG): container finished" podID="c86b9208-11fe-431e-9072-efc30a2ede19" containerID="a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b" exitCode=0
Oct 30 22:20:30.571951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.571774    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"
Oct 30 22:20:30.571951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.571796    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" event={"ID":"c86b9208-11fe-431e-9072-efc30a2ede19","Type":"ContainerDied","Data":"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"}
Oct 30 22:20:30.571951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.571848    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc" event={"ID":"c86b9208-11fe-431e-9072-efc30a2ede19","Type":"ContainerDied","Data":"c950ca490faec490489e2560bf7dda5f8c6971d58fb8fb389bbacc397a18a408"}
Oct 30 22:20:30.571951 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.571871    5579 scope.go:122] "RemoveContainer" containerID="a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"
Oct 30 22:20:30.582080 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.582065    5579 scope.go:122] "RemoveContainer" containerID="a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"
Oct 30 22:20:30.582375 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:30.582360    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b\": container with ID starting with a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b not found: ID does not exist" containerID="a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"
Oct 30 22:20:30.582421 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.582384    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b"} err="failed to get container status \"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b\": rpc error: code = NotFound desc = could not find container \"a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b\": container with ID starting with a23633f6600014d4d9d28d6e06b1ff1b2d15c2752761fe7411c8f436e4fe738b not found: ID does not exist"
Oct 30 22:20:30.731781 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.728982    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:20:30.741911 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:30.741876    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5fef81-6b5bb6c966-gmshc"]
Oct 30 22:20:31.146636 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:31.146597    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c86b9208-11fe-431e-9072-efc30a2ede19" path="/var/lib/kubelet/pods/c86b9208-11fe-431e-9072-efc30a2ede19/volumes"
Oct 30 22:20:34.566188 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:34.566158    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:20:35.907035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.907000    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:20:35.907630 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.907609    5579 cpu_manager.go:414] "containerMap: removing container" podUID="c86b9208-11fe-431e-9072-efc30a2ede19" containerName="maas-api"
Oct 30 22:20:35.907765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.907630    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c86b9208-11fe-431e-9072-efc30a2ede19" containerName="maas-api"
Oct 30 22:20:35.907765 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.907754    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="c86b9208-11fe-431e-9072-efc30a2ede19" containerName="maas-api"
Oct 30 22:20:35.912961 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.912914    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:35.961626 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:35.961590    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-778d39d3-openshift-default-dockercfg-9jkcd\""
Oct 30 22:20:36.003597 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.003558    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28fjd\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.003797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.003603    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.003797 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.003721    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.003914 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.003793    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.003987 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.003920    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.004033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.004012    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.004158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.004139    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.004202 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.004171    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.004202 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.004193    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.105911 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.105870    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.105920    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.105960    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.105991    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28fjd\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106016    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106046    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106162 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106087    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106224    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106289    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106446    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106557    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106645    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106812    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.106830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.106809    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.108224 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.108203    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.108499 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.108480    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.129752 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.129720    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:20:36.161447 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.161384    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.161615 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.161589    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28fjd\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-thz54\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.226062 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.226020    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:36.655816 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.655780    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:20:36.697420 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:36.697389    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9868e3_6ffc_4633_945b_4b5a991853dc.slice/crio-bef4d6a1df1c24d7160458414ca8f9bf1f922affce4be1bbf3827ff3eaac068b WatchSource:0}: Error finding container bef4d6a1df1c24d7160458414ca8f9bf1f922affce4be1bbf3827ff3eaac068b: Status 404 returned error can't find the container with id bef4d6a1df1c24d7160458414ca8f9bf1f922affce4be1bbf3827ff3eaac068b
Oct 30 22:20:36.700053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.700019    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:36.700145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.700086    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:36.700145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:36.700114    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:37.616689 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:37.616647    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" event={"ID":"ab9868e3-6ffc-4633-945b-4b5a991853dc","Type":"ContainerStarted","Data":"5722e828ca39f60a20b09789e34b8f0a58b283a6ea14055263430599781a56f5"}
Oct 30 22:20:37.617208 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:37.616710    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" event={"ID":"ab9868e3-6ffc-4633-945b-4b5a991853dc","Type":"ContainerStarted","Data":"bef4d6a1df1c24d7160458414ca8f9bf1f922affce4be1bbf3827ff3eaac068b"}
Oct 30 22:20:37.777870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:37.777801    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podStartSLOduration=2.777782569 podStartE2EDuration="2.777782569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:37.775438114 +0000 UTC m=+2242.745284548" watchObservedRunningTime="2026-10-30 22:20:37.777782569 +0000 UTC m=+2242.747628979"
Oct 30 22:20:38.232019 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:38.231987    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:38.232408 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:38.232383    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-thz54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:20:38.232589 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:38.232565    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused"
Oct 30 22:20:39.228955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:39.226425    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-thz54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:20:39.228955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:39.226487    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused"
Oct 30 22:20:40.244952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:40.244357    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-thz54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:20:40.244952 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:40.244438    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused"
Oct 30 22:20:41.246979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:41.238297    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-thz54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:20:41.246979 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:41.238395    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused"
Oct 30 22:20:42.242956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.234333    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-thz54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:20:42.242956 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.234409    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.113:15021/healthz/ready\": dial tcp 10.134.0.113:15021: connect: connection refused"
Oct 30 22:20:42.548383 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.548290    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7185-57a433"]
Oct 30 22:20:42.553277 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.553254    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:42.606710 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.606674    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-57a433"]
Oct 30 22:20:42.649801 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.649766    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-74ld5\""
Oct 30 22:20:42.709279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.709242    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vgd\" (UniqueName: \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\") pod \"test-curl-7185-57a433\" (UID: \"13f511c0-76a8-4320-b042-e2243389f100\") " pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:42.810337 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.810237    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vgd\" (UniqueName: \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\") pod \"test-curl-7185-57a433\" (UID: \"13f511c0-76a8-4320-b042-e2243389f100\") " pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:42.864233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.864203    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vgd\" (UniqueName: \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\") pod \"test-curl-7185-57a433\" (UID: \"13f511c0-76a8-4320-b042-e2243389f100\") " pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:42.865976 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:42.865951    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:42.938217 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:42.937923    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:20:43.231551 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.231522    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:43.231985 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.231962    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:43.232678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.232661    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:20:43.237860 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.237834    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7185-57a433"]
Oct 30 22:20:43.243145 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:43.243120    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13f511c0_76a8_4320_b042_e2243389f100.slice/crio-afdb1e6b7dc06928de4d50b14ccf71b59d95cfecd3745e2029307fcb999c6dfd WatchSource:0}: Error finding container afdb1e6b7dc06928de4d50b14ccf71b59d95cfecd3745e2029307fcb999c6dfd: Status 404 returned error can't find the container with id afdb1e6b7dc06928de4d50b14ccf71b59d95cfecd3745e2029307fcb999c6dfd
Oct 30 22:20:43.679138 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.679102    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-57a433" event={"ID":"13f511c0-76a8-4320-b042-e2243389f100","Type":"ContainerStarted","Data":"0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782"}
Oct 30 22:20:43.679138 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.679145    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7185-57a433" event={"ID":"13f511c0-76a8-4320-b042-e2243389f100","Type":"ContainerStarted","Data":"afdb1e6b7dc06928de4d50b14ccf71b59d95cfecd3745e2029307fcb999c6dfd"}
Oct 30 22:20:43.788715 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:43.788663    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7185-57a433" podStartSLOduration=1.788649687 podStartE2EDuration="1.788649687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:43.7856311 +0000 UTC m=+2248.755477510" watchObservedRunningTime="2026-10-30 22:20:43.788649687 +0000 UTC m=+2248.758496096"
Oct 30 22:20:45.259212 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:45.259174    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7185-57a433"]
Oct 30 22:20:45.262146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:45.262120    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7185-57a433"]
Oct 30 22:20:45.690645 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:45.690611    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7185-57a433" podUID="13f511c0-76a8-4320-b042-e2243389f100" containerName="test-curl-7185-57a433" containerID="cri-o://0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782" gracePeriod=2
Oct 30 22:20:45.738167 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:45.738103    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-57a433\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="13f511c0-76a8-4320-b042-e2243389f100" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:47.975734 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:47.975709    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:48.070889 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.070852    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\" (UniqueName: \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\") pod \"13f511c0-76a8-4320-b042-e2243389f100\" (UID: \"13f511c0-76a8-4320-b042-e2243389f100\") "
Oct 30 22:20:48.073005 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.072981    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd" pod "13f511c0-76a8-4320-b042-e2243389f100" (UID: "13f511c0-76a8-4320-b042-e2243389f100"). InnerVolumeSpecName "kube-api-access-z8vgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:48.172969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.172906    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8vgd\" (UniqueName: \"kubernetes.io/projected/13f511c0-76a8-4320-b042-e2243389f100-kube-api-access-z8vgd\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:20:48.709535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.709497    5579 generic.go:356] "Generic (PLEG): container finished" podID="13f511c0-76a8-4320-b042-e2243389f100" containerID="0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782" exitCode=137
Oct 30 22:20:48.709750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.709544    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:48.709750 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.709607    5579 scope.go:122] "RemoveContainer" containerID="0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782"
Oct 30 22:20:48.720547 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.720527    5579 scope.go:122] "RemoveContainer" containerID="0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782"
Oct 30 22:20:48.720848 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:48.720829    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782\": container with ID starting with 0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782 not found: ID does not exist" containerID="0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782"
Oct 30 22:20:48.720909 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:48.720857    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782"} err="failed to get container status \"0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782\": rpc error: code = NotFound desc = could not find container \"0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782\": container with ID starting with 0dea03481a79bab5810f48e1e2824e1b3eb5cde562741a2693194184117fc782 not found: ID does not exist"
Oct 30 22:20:48.766534 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:20:48.766493    5579 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7185-57a433\" is forbidden: User \"system:node:ip-10-0-139-66.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-66.us-west-2.compute.internal' and this object" podUID="13f511c0-76a8-4320-b042-e2243389f100" pod="opendatahub/test-curl-7185-57a433"
Oct 30 22:20:49.146610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:49.146576    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13f511c0-76a8-4320-b042-e2243389f100" path="/var/lib/kubelet/pods/13f511c0-76a8-4320-b042-e2243389f100/volumes"
Oct 30 22:20:51.030254 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.030219    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:20:51.030920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.030899    5579 cpu_manager.go:414] "containerMap: removing container" podUID="13f511c0-76a8-4320-b042-e2243389f100" containerName="test-curl-7185-57a433"
Oct 30 22:20:51.031028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.030924    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13f511c0-76a8-4320-b042-e2243389f100" containerName="test-curl-7185-57a433"
Oct 30 22:20:51.031092 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.031081    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="13f511c0-76a8-4320-b042-e2243389f100" containerName="test-curl-7185-57a433"
Oct 30 22:20:51.036022 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.036004    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210368 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210325    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210383    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210477    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210546    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210696    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210806 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210757    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210874 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210861    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.210919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.210891    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbvrj\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.211023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.211002    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.253997 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.253964    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:20:51.312028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.311858    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312028 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.311976    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312090    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312126    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312172    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312210    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbvrj\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312267 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312263    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312298    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312340    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312337    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312386    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312752 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312571    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.312752 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.312733    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.313160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.313139    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.314794 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.314766    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.314907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.314887    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.370485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.370449    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.370660 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.370621    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbvrj\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-srtrc\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:51.649692 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:51.649653    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:52.078294 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.078193    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:20:52.084309 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:20:52.084285    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360f4fbf_165a_4191_ab61_8d32c468d759.slice/crio-356a9fd0618a22e63b24b66c643985124af6a61a4957bd036ccb49d7a5c006f7 WatchSource:0}: Error finding container 356a9fd0618a22e63b24b66c643985124af6a61a4957bd036ccb49d7a5c006f7: Status 404 returned error can't find the container with id 356a9fd0618a22e63b24b66c643985124af6a61a4957bd036ccb49d7a5c006f7
Oct 30 22:20:52.086845 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.086808    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:52.086993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.086904    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:52.087073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.086989    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:20:52.746828 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.746763    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" event={"ID":"360f4fbf-165a-4191-ab61-8d32c468d759","Type":"ContainerStarted","Data":"1fcc2d29b6fac8d67f747accc51de30c5a8d3ee03a0723686f8f569881eeb146"}
Oct 30 22:20:52.747074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.746850    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" event={"ID":"360f4fbf-165a-4191-ab61-8d32c468d759","Type":"ContainerStarted","Data":"356a9fd0618a22e63b24b66c643985124af6a61a4957bd036ccb49d7a5c006f7"}
Oct 30 22:20:52.984953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:52.970749    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podStartSLOduration=2.970728435 podStartE2EDuration="2.970728435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:52.906033533 +0000 UTC m=+2257.875879942" watchObservedRunningTime="2026-10-30 22:20:52.970728435 +0000 UTC m=+2257.940574846"
Oct 30 22:20:53.653142 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:53.653020    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:53.654845 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:53.654812    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:53.655023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:53.654867    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:54.650479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:54.650437    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:54.650666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:54.650495    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:55.650219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:55.650181    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:55.650646 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:55.650239    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:56.650429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:56.650395    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:56.650851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:56.650451    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:57.650748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:57.650704    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:57.651210 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:57.650781    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:58.650417 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:58.650381    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused" start-of-body=
Oct 30 22:20:58.650649 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:58.650434    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.115:15021/healthz/ready\": dial tcp 10.134.0.115:15021: connect: connection refused"
Oct 30 22:20:59.654558 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:59.654529    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:59.655071 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:59.654968    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:20:59.655732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:20:59.655712    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:21:02.647834 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:02.647795    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 22:21:02.648389 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:02.648096    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" podUID="07f6e2a2-cbce-4913-8ab0-adf61371c969" containerName="maas-api" containerID="cri-o://df02c72c80ed3808a9c23e8a9a4e1ab8fd9f0957f7749445789fb3db5e9c6da3" gracePeriod=30
Oct 30 22:21:02.830123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:02.830084    5579 generic.go:356] "Generic (PLEG): container finished" podID="07f6e2a2-cbce-4913-8ab0-adf61371c969" containerID="df02c72c80ed3808a9c23e8a9a4e1ab8fd9f0957f7749445789fb3db5e9c6da3" exitCode=0
Oct 30 22:21:02.830338 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:02.830162    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" event={"ID":"07f6e2a2-cbce-4913-8ab0-adf61371c969","Type":"ContainerDied","Data":"df02c72c80ed3808a9c23e8a9a4e1ab8fd9f0957f7749445789fb3db5e9c6da3"}
Oct 30 22:21:03.003055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.003024    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 22:21:03.119674 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.119639    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\" (UniqueName: \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\") pod \"07f6e2a2-cbce-4913-8ab0-adf61371c969\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") "
Oct 30 22:21:03.119892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.119707    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\") pod \"07f6e2a2-cbce-4913-8ab0-adf61371c969\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") "
Oct 30 22:21:03.119892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.119842    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\") pod \"07f6e2a2-cbce-4913-8ab0-adf61371c969\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") "
Oct 30 22:21:03.120061 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.120020    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\") pod \"07f6e2a2-cbce-4913-8ab0-adf61371c969\" (UID: \"07f6e2a2-cbce-4913-8ab0-adf61371c969\") "
Oct 30 22:21:03.120650 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.120553    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca" pod "07f6e2a2-cbce-4913-8ab0-adf61371c969" (UID: "07f6e2a2-cbce-4913-8ab0-adf61371c969"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:03.121006 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.120985    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f6e2a2-cbce-4913-8ab0-adf61371c969-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:03.122615 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.122585    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs" pod "07f6e2a2-cbce-4913-8ab0-adf61371c969" (UID: "07f6e2a2-cbce-4913-8ab0-adf61371c969"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:21:03.122615 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.122597    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57" pod "07f6e2a2-cbce-4913-8ab0-adf61371c969" (UID: "07f6e2a2-cbce-4913-8ab0-adf61371c969"). InnerVolumeSpecName "kube-api-access-bvq57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:03.123324 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.123302    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls" pod "07f6e2a2-cbce-4913-8ab0-adf61371c969" (UID: "07f6e2a2-cbce-4913-8ab0-adf61371c969"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:21:03.223093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.222996    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:03.223093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.223034    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvq57\" (UniqueName: \"kubernetes.io/projected/07f6e2a2-cbce-4913-8ab0-adf61371c969-kube-api-access-bvq57\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:03.223093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.223052    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f6e2a2-cbce-4913-8ab0-adf61371c969-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:03.837756 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.837724    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"
Oct 30 22:21:03.838443 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.837757    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg" event={"ID":"07f6e2a2-cbce-4913-8ab0-adf61371c969","Type":"ContainerDied","Data":"9d352c24e73dc12ccd454f17e2e92ab818f6cfe4ef7c45b11c39ba5902f76561"}
Oct 30 22:21:03.838443 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.837830    5579 scope.go:122] "RemoveContainer" containerID="df02c72c80ed3808a9c23e8a9a4e1ab8fd9f0957f7749445789fb3db5e9c6da3"
Oct 30 22:21:03.993725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:03.993684    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 22:21:04.040009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:04.039969    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f776cb-7657547797-szhkg"]
Oct 30 22:21:05.148665 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:05.148634    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07f6e2a2-cbce-4913-8ab0-adf61371c969" path="/var/lib/kubelet/pods/07f6e2a2-cbce-4913-8ab0-adf61371c969/volumes"
Oct 30 22:21:06.132207 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.132173    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:21:06.132925 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.132901    5579 cpu_manager.go:414] "containerMap: removing container" podUID="07f6e2a2-cbce-4913-8ab0-adf61371c969" containerName="maas-api"
Oct 30 22:21:06.132925 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.132940    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07f6e2a2-cbce-4913-8ab0-adf61371c969" containerName="maas-api"
Oct 30 22:21:06.133101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.133076    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="07f6e2a2-cbce-4913-8ab0-adf61371c969" containerName="maas-api"
Oct 30 22:21:06.137685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.137665    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.236385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.236351    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:21:06.263273 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263233    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263492 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263400    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263492 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263469    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263627 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263565    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263656    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263771 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263752    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263836 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263815    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qmq\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263880    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.263993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.263975    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365393 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365354    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365405    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365438    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365477    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365512    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qmq\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365577 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365542    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365596    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365631    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365733    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.365886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.365855    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.366140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.366034    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.366232 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.366206    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.366308 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.366283    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.366553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.366531    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.368140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.368119    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.368270 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.368252    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.418919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.418883    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qmq\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.418919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.418898    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\") pod \"e2e-mt-778d39d3-openshift-default-bff74755c-7fstr\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") " pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.457400 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.457365    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:06.890385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.890354    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:21:06.932260 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:21:06.932223    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf48e57_3c4e_41d2_b28a_7939a6ca1b06.slice/crio-19becdde2b4e014b903b38ed95faa546d5c2a553bbbafc8255e59f3b2daecab2 WatchSource:0}: Error finding container 19becdde2b4e014b903b38ed95faa546d5c2a553bbbafc8255e59f3b2daecab2: Status 404 returned error can't find the container with id 19becdde2b4e014b903b38ed95faa546d5c2a553bbbafc8255e59f3b2daecab2
Oct 30 22:21:06.934775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.934738    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:21:06.934870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.934811    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:21:06.934870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:06.934841    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:21:07.870166 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:07.870122    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" event={"ID":"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06","Type":"ContainerStarted","Data":"8af9a1e14284a9bda4d40ed56b5baafcb1ace643ff11d4dda58addc53335762f"}
Oct 30 22:21:07.870585 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:07.870187    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" event={"ID":"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06","Type":"ContainerStarted","Data":"19becdde2b4e014b903b38ed95faa546d5c2a553bbbafc8255e59f3b2daecab2"}
Oct 30 22:21:07.999669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:07.999618    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podStartSLOduration=1.999600764 podStartE2EDuration="1.999600764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:07.997418913 +0000 UTC m=+2272.967265324" watchObservedRunningTime="2026-10-30 22:21:07.999600764 +0000 UTC m=+2272.969447174"
Oct 30 22:21:08.458493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:08.458459    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:08.460213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:08.460184    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:08.460384 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:08.460242    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:09.059446 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.059407    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:21:09.059919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.059686    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" podUID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" containerName="maas-api" containerID="cri-o://edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293" gracePeriod=30
Oct 30 22:21:09.476955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.459311    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:09.476955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.459380    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:09.593165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.592843    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:21:09.710969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.710900    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\") pod \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") "
Oct 30 22:21:09.710969 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.710958    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\") pod \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") "
Oct 30 22:21:09.711231 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.711042    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\" (UniqueName: \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\") pod \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") "
Oct 30 22:21:09.711231 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.711101    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") pod \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\" (UID: \"3f914e10-140b-49db-a4f6-d1bfbf1c0768\") "
Oct 30 22:21:09.712147 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.712026    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca" pod "3f914e10-140b-49db-a4f6-d1bfbf1c0768" (UID: "3f914e10-140b-49db-a4f6-d1bfbf1c0768"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:09.713617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.713588    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs" pod "3f914e10-140b-49db-a4f6-d1bfbf1c0768" (UID: "3f914e10-140b-49db-a4f6-d1bfbf1c0768"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:21:09.713818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.713798    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6" pod "3f914e10-140b-49db-a4f6-d1bfbf1c0768" (UID: "3f914e10-140b-49db-a4f6-d1bfbf1c0768"). InnerVolumeSpecName "kube-api-access-9hsj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:09.714021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.714003    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls" pod "3f914e10-140b-49db-a4f6-d1bfbf1c0768" (UID: "3f914e10-140b-49db-a4f6-d1bfbf1c0768"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:21:09.813035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.812941    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:09.813035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.812975    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f914e10-140b-49db-a4f6-d1bfbf1c0768-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:09.813035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.812989    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hsj6\" (UniqueName: \"kubernetes.io/projected/3f914e10-140b-49db-a4f6-d1bfbf1c0768-kube-api-access-9hsj6\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:09.813035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.813006    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f914e10-140b-49db-a4f6-d1bfbf1c0768-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:09.886179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.886147    5579 generic.go:356] "Generic (PLEG): container finished" podID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" containerID="edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293" exitCode=0
Oct 30 22:21:09.886334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.886198    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"
Oct 30 22:21:09.886334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.886234    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" event={"ID":"3f914e10-140b-49db-a4f6-d1bfbf1c0768","Type":"ContainerDied","Data":"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"}
Oct 30 22:21:09.886334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.886289    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7" event={"ID":"3f914e10-140b-49db-a4f6-d1bfbf1c0768","Type":"ContainerDied","Data":"106a2a4b17c3e50d1bf688070d8d0711da050f1d76d9d209bc17d0d858e2da0c"}
Oct 30 22:21:09.886334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.886317    5579 scope.go:122] "RemoveContainer" containerID="edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"
Oct 30 22:21:09.898119 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.898095    5579 scope.go:122] "RemoveContainer" containerID="edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"
Oct 30 22:21:09.898472 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:21:09.898447    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293\": container with ID starting with edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293 not found: ID does not exist" containerID="edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"
Oct 30 22:21:09.898539 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:09.898485    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293"} err="failed to get container status \"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293\": rpc error: code = NotFound desc = could not find container \"edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293\": container with ID starting with edb706958cc83e33f9b39f907f62736378f7569f4bcf134d1a4657b8576d0293 not found: ID does not exist"
Oct 30 22:21:10.055859 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:10.055820    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:21:10.060247 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:10.060218    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4215ed-6b5b9c55f-f49p7"]
Oct 30 22:21:10.458493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:10.458441    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:10.458684 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:10.458504    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:11.155570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:11.155536    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" path="/var/lib/kubelet/pods/3f914e10-140b-49db-a4f6-d1bfbf1c0768/volumes"
Oct 30 22:21:11.458747 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:11.458665    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:11.458747 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:11.458725    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:11.995986 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:11.995947    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 22:21:11.996276 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:11.996222    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" containerID="cri-o://5652a91ddecc52d560eb49a6c149596ac2d3ff59a4a9ff90b8c29a5125b462f4" gracePeriod=30
Oct 30 22:21:12.457837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:12.457798    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:12.458260 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:12.457877    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:12.981441 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:21:12.981159    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:21:13.458678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:13.458642    5579 patch_prober.go:29] interesting pod/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:21:13.459133 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:13.458700    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.116:15021/healthz/ready\": dial tcp 10.134.0.116:15021: connect: connection refused"
Oct 30 22:21:14.464092 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:14.464064    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:14.464587 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:14.464564    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:14.465299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:14.465279    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:21:15.530599 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:15.530561    5579 patch_prober.go:29] interesting pod/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:21:15.531000 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:15.530624    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:21:17.267707 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.267648    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 22:21:17.349570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349536    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349581    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349635    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349670    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349725 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349706    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349734    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349779    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349805    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.349965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349856    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:17.349965 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.349893    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\") pod \"a66bba9d-b54a-470a-8c85-c36d84665167\" (UID: \"a66bba9d-b54a-470a-8c85-c36d84665167\") "
Oct 30 22:21:17.350239 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350102    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:17.350239 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350208    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:17.350350 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350329    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:17.350494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350464    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:17.350494 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350486    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.350619 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350505    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.350619 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350519    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.350619 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.350532    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a66bba9d-b54a-470a-8c85-c36d84665167-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.351857 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.351830    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "kube-api-access-8j47v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:17.352035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.352004    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:21:17.352330 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.352306    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:17.352413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.352346    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token" pod "a66bba9d-b54a-470a-8c85-c36d84665167" (UID: "a66bba9d-b54a-470a-8c85-c36d84665167"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:17.451622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.451587    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j47v\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-kube-api-access-8j47v\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.451622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.451625    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.451824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.451641    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a66bba9d-b54a-470a-8c85-c36d84665167-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.451824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.451655    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a66bba9d-b54a-470a-8c85-c36d84665167-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.451824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.451671    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66bba9d-b54a-470a-8c85-c36d84665167-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:21:17.464883 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.464855    5579 scope.go:122] "RemoveContainer" containerID="5652a91ddecc52d560eb49a6c149596ac2d3ff59a4a9ff90b8c29a5125b462f4"
Oct 30 22:21:17.956788 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.956756    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"
Oct 30 22:21:17.956968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.956754    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" event={"ID":"a66bba9d-b54a-470a-8c85-c36d84665167","Type":"ContainerDied","Data":"5652a91ddecc52d560eb49a6c149596ac2d3ff59a4a9ff90b8c29a5125b462f4"}
Oct 30 22:21:17.956968 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:17.956903    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj" event={"ID":"a66bba9d-b54a-470a-8c85-c36d84665167","Type":"ContainerDied","Data":"fe58d3a842175be2d48cc947211b2d95e6378109f1ab5a2c3fe9023f8492e6af"}
Oct 30 22:21:18.225485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:18.225392    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 22:21:18.229544 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:18.229506    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f776cb-openshift-default-74d577586f-kcpfj"]
Oct 30 22:21:19.146429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:19.146390    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" path="/var/lib/kubelet/pods/a66bba9d-b54a-470a-8c85-c36d84665167/volumes"
Oct 30 22:21:23.025283 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025248    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:21:23.025795 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025779    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy"
Oct 30 22:21:23.025795 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025794    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy"
Oct 30 22:21:23.025889 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025809    5579 cpu_manager.go:414] "containerMap: removing container" podUID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" containerName="maas-api"
Oct 30 22:21:23.025889 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025814    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" containerName="maas-api"
Oct 30 22:21:23.026053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025923    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f914e10-140b-49db-a4f6-d1bfbf1c0768" containerName="maas-api"
Oct 30 22:21:23.026053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.025964    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a66bba9d-b54a-470a-8c85-c36d84665167" containerName="istio-proxy"
Oct 30 22:21:23.031227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.031200    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.082915 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.082882    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 22:21:23.083139 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.082955    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 22:21:23.128896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.128867    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dwlzg\""
Oct 30 22:21:23.129075 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.128897    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 22:21:23.147732 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.147702    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:21:23.217844 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.217800    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.217862    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218073 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.218041    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218181 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.218080    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.218182    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44tl\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218260 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.218225    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.218353 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.218338    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319272    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319387    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319507    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319610 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319561    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319609    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319624    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.319802 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.319686    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44tl\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.320413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.320383    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.321748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.321726    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.322039 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.322014    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.322145 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.322086    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.322211 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.322153    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.374176 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.374146    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44tl\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.374356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.374280    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-s95n6\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:23.644817 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:23.644783    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:24.077836 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:24.077761    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:21:24.082256 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:21:24.082230    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d33aa2_80f8_4cc0_899c_baf14c5d6f6a.slice/crio-a9d1933023e5bed4ef919c6f9189c1370cae0f617f23bf5966e8017a0f05fdd8 WatchSource:0}: Error finding container a9d1933023e5bed4ef919c6f9189c1370cae0f617f23bf5966e8017a0f05fdd8: Status 404 returned error can't find the container with id a9d1933023e5bed4ef919c6f9189c1370cae0f617f23bf5966e8017a0f05fdd8
Oct 30 22:21:24.084973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:24.084918    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:21:24.085055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:24.085001    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:21:25.003289 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.003251    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" event={"ID":"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a","Type":"ContainerStarted","Data":"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"}
Oct 30 22:21:25.003506 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.003309    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" event={"ID":"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a","Type":"ContainerStarted","Data":"a9d1933023e5bed4ef919c6f9189c1370cae0f617f23bf5966e8017a0f05fdd8"}
Oct 30 22:21:25.003506 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.003411    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:25.005319 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.005291    5579 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-s95n6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:21:25.005444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.005352    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:21:25.196429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:25.196294    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" podStartSLOduration=3.196271316 podStartE2EDuration="3.196271316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:25.19590447 +0000 UTC m=+2290.165750892" watchObservedRunningTime="2026-10-30 22:21:25.196271316 +0000 UTC m=+2290.166117727"
Oct 30 22:21:26.011298 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:21:26.011269    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:21:42.930275 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:21:42.930238    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:22:12.931426 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:22:12.931386    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:22:36.350339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:36.350251    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:22:36.396086 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:36.396042    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 22:22:42.932025 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:22:42.931987    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:22:47.404718 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:47.404680    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:22:48.430149 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.430077    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:22:48.430628 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.430324    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy" containerID="cri-o://1fcc2d29b6fac8d67f747accc51de30c5a8d3ee03a0723686f8f569881eeb146" gracePeriod=30
Oct 30 22:22:48.441528 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.441500    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:22:48.441715 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.441694    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy" containerID="cri-o://8af9a1e14284a9bda4d40ed56b5baafcb1ace643ff11d4dda58addc53335762f" gracePeriod=30
Oct 30 22:22:48.447603 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.447573    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:22:48.447781 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:48.447758    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy" containerID="cri-o://5722e828ca39f60a20b09789e34b8f0a58b283a6ea14055263430599781a56f5" gracePeriod=30
Oct 30 22:22:51.372427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.372370    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main" containerID="cri-o://a0d0706e785417e6c54cfbfcfe7a559bdb462797fe40cff525f8736f04aa4d71" gracePeriod=45
Oct 30 22:22:51.416846 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.416805    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main" containerID="cri-o://bd9e9bc363ec9a4674e894b2b896a27f05faa9b46f595ae2bd4052043628f814" gracePeriod=45
Oct 30 22:22:51.580106 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.580069    5579 generic.go:356] "Generic (PLEG): container finished" podID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerID="a0d0706e785417e6c54cfbfcfe7a559bdb462797fe40cff525f8736f04aa4d71" exitCode=0
Oct 30 22:22:51.580296 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.580212    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" event={"ID":"ab9268e2-6e2e-4ed6-9730-43e136c37e4b","Type":"ContainerDied","Data":"a0d0706e785417e6c54cfbfcfe7a559bdb462797fe40cff525f8736f04aa4d71"}
Oct 30 22:22:51.581884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.581860    5579 generic.go:356] "Generic (PLEG): container finished" podID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerID="bd9e9bc363ec9a4674e894b2b896a27f05faa9b46f595ae2bd4052043628f814" exitCode=0
Oct 30 22:22:51.582037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.581923    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" event={"ID":"6b8fa0de-0861-4b87-96eb-5d2641752395","Type":"ContainerDied","Data":"bd9e9bc363ec9a4674e894b2b896a27f05faa9b46f595ae2bd4052043628f814"}
Oct 30 22:22:51.701399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.701374    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:22:51.724165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.724130    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:22:51.739068 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739033    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739076    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739107    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739149    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\" (UniqueName: \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739209    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739287    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\") pod \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\" (UID: \"ab9268e2-6e2e-4ed6-9730-43e136c37e4b\") "
Oct 30 22:22:51.739480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739388    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.739480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739398    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.739480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739453    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.739821 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739800    5579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-home\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.739899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739827    5579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-model-cache\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.739899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.739865    5579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tmp-dir\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.741734 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.741711    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.741734 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.741729    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "kube-api-access-wsg6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:51.741902 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.741799    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs" pod "ab9268e2-6e2e-4ed6-9730-43e136c37e4b" (UID: "ab9268e2-6e2e-4ed6-9730-43e136c37e4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:51.841208 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841172    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841248    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841285    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841401 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841317    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\" (UniqueName: \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841590 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841453    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841590 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841504    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\") pod \"6b8fa0de-0861-4b87-96eb-5d2641752395\" (UID: \"6b8fa0de-0861-4b87-96eb-5d2641752395\") "
Oct 30 22:22:51.841854 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841833    5579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-tls-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.841854 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841854    5579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-dshm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.842018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.841865    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsg6r\" (UniqueName: \"kubernetes.io/projected/ab9268e2-6e2e-4ed6-9730-43e136c37e4b-kube-api-access-wsg6r\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.842082 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.842071    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.842213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.842198    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.842693 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.842666    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.844269 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.844243    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:51.844833 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.844805    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "kube-api-access-g46wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:51.845327 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.845302    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs" pod "6b8fa0de-0861-4b87-96eb-5d2641752395" (UID: "6b8fa0de-0861-4b87-96eb-5d2641752395"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:51.943233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943151    5579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-dshm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.943233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943187    5579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-tmp-dir\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.943233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943202    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g46wp\" (UniqueName: \"kubernetes.io/projected/6b8fa0de-0861-4b87-96eb-5d2641752395-kube-api-access-g46wp\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.943233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943215    5579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b8fa0de-0861-4b87-96eb-5d2641752395-tls-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.943233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943229    5579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-model-cache\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:51.943673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:51.943244    5579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b8fa0de-0861-4b87-96eb-5d2641752395-home\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:52.589332 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.589305    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"
Oct 30 22:22:52.589834 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.589337    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr" event={"ID":"ab9268e2-6e2e-4ed6-9730-43e136c37e4b","Type":"ContainerDied","Data":"35f3dca69d77085cbedc347636a56ef3963942a103152687f10d51c14a9dd620"}
Oct 30 22:22:52.589834 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.589395    5579 scope.go:122] "RemoveContainer" containerID="a0d0706e785417e6c54cfbfcfe7a559bdb462797fe40cff525f8736f04aa4d71"
Oct 30 22:22:52.591007 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.590916    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"
Oct 30 22:22:52.591007 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.590950    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr" event={"ID":"6b8fa0de-0861-4b87-96eb-5d2641752395","Type":"ContainerDied","Data":"7de36b1b449bba9ced498a857436e4ab73609252816cf950bbf8cbc8645eca9b"}
Oct 30 22:22:52.599358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.599339    5579 scope.go:122] "RemoveContainer" containerID="bd9e9bc363ec9a4674e894b2b896a27f05faa9b46f595ae2bd4052043628f814"
Oct 30 22:22:52.742540 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.742461    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:22:52.788637 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.788599    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-2-w1-a07620-kserve-8658cb55c7-km9rr"]
Oct 30 22:22:52.850159 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.850123    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 22:22:52.853552 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:52.853526    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a07620/distinct-w1-a07620-kserve-565d9f4498-qrtqr"]
Oct 30 22:22:53.148678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.148641    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" path="/var/lib/kubelet/pods/6b8fa0de-0861-4b87-96eb-5d2641752395/volumes"
Oct 30 22:22:53.149343 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.149320    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" path="/var/lib/kubelet/pods/ab9268e2-6e2e-4ed6-9730-43e136c37e4b/volumes"
Oct 30 22:22:53.604388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.603562    5579 generic.go:356] "Generic (PLEG): container finished" podID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerID="5722e828ca39f60a20b09789e34b8f0a58b283a6ea14055263430599781a56f5" exitCode=0
Oct 30 22:22:53.604388 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.603642    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" event={"ID":"ab9868e3-6ffc-4633-945b-4b5a991853dc","Type":"ContainerDied","Data":"5722e828ca39f60a20b09789e34b8f0a58b283a6ea14055263430599781a56f5"}
Oct 30 22:22:53.605631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.605601    5579 generic.go:356] "Generic (PLEG): container finished" podID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerID="8af9a1e14284a9bda4d40ed56b5baafcb1ace643ff11d4dda58addc53335762f" exitCode=0
Oct 30 22:22:53.605767 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.605684    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" event={"ID":"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06","Type":"ContainerDied","Data":"8af9a1e14284a9bda4d40ed56b5baafcb1ace643ff11d4dda58addc53335762f"}
Oct 30 22:22:53.608551 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.608524    5579 generic.go:356] "Generic (PLEG): container finished" podID="360f4fbf-165a-4191-ab61-8d32c468d759" containerID="1fcc2d29b6fac8d67f747accc51de30c5a8d3ee03a0723686f8f569881eeb146" exitCode=0
Oct 30 22:22:53.608705 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.608614    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" event={"ID":"360f4fbf-165a-4191-ab61-8d32c468d759","Type":"ContainerDied","Data":"1fcc2d29b6fac8d67f747accc51de30c5a8d3ee03a0723686f8f569881eeb146"}
Oct 30 22:22:53.724231 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.724205    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:22:53.765287 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765252    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765432 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765304    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765432 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765366    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765518 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765444    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765584    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765658    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765673    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:53.765724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765709    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765836 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765752    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.765836 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.765818    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\") pod \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\" (UID: \"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06\") "
Oct 30 22:22:53.766224 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.766199    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.766339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.766281    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.766400 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.766376    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.766962 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.766503    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.766962 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.766911    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.769130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.769107    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.769974 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.769953    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:53.770451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.770431    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.770542 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.770455    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq" pod "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" (UID: "bbf48e57-3c4e-41d2-b28a-7939a6ca1b06"). InnerVolumeSpecName "kube-api-access-q7qmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.792143 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.792119    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:22:53.794312 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.794292    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:22:53.867031 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.866999    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867040    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.867223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867098    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867128    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867182    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.867223 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867205    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.867503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867236    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.867503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867382    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.867503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867405    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.867503 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867467    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867565    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867520    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867618    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867654    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867667    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.867793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867735    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867796    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867838    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.867916    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\") pod \"360f4fbf-165a-4191-ab61-8d32c468d759\" (UID: \"360f4fbf-165a-4191-ab61-8d32c468d759\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868028    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868079    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868109    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:53.868140 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868119    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\") pod \"ab9868e3-6ffc-4633-945b-4b5a991853dc\" (UID: \"ab9868e3-6ffc-4633-945b-4b5a991853dc\") "
Oct 30 22:22:53.868499 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868310    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.868560 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868493    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.868754 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868731    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.868844 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868822    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.868906 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868853    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.868906 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868868    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.868906 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868883    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.868906 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868897    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868910    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868908    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868925    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868981    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.868994    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360f4fbf-165a-4191-ab61-8d32c468d759-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869008    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869021    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869037    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7qmq\" (UniqueName: \"kubernetes.io/projected/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-kube-api-access-q7qmq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869052    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869066    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869081    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.869728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869429    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:53.869791 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.869768    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.870163 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.870133    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.870288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.870168    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "kube-api-access-cbvrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.870288 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.870195    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.871186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.871154    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:53.871444 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.871425    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:53.871682 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.871664    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy" pod "360f4fbf-165a-4191-ab61-8d32c468d759" (UID: "360f4fbf-165a-4191-ab61-8d32c468d759"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:53.871794 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.871773    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd" pod "ab9868e3-6ffc-4633-945b-4b5a991853dc" (UID: "ab9868e3-6ffc-4633-945b-4b5a991853dc"). InnerVolumeSpecName "kube-api-access-28fjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:53.970818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970731    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab9868e3-6ffc-4633-945b-4b5a991853dc-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.970818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970776    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28fjd\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-kube-api-access-28fjd\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.970818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970793    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.970818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970807    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.970818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970820    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970835    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970849    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab9868e3-6ffc-4633-945b-4b5a991853dc-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970862    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbvrj\" (UniqueName: \"kubernetes.io/projected/360f4fbf-165a-4191-ab61-8d32c468d759-kube-api-access-cbvrj\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970877    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab9868e3-6ffc-4633-945b-4b5a991853dc-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970891    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360f4fbf-165a-4191-ab61-8d32c468d759-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:53.971183 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:53.970904    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360f4fbf-165a-4191-ab61-8d32c468d759-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:22:54.617829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.617795    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr" event={"ID":"bbf48e57-3c4e-41d2-b28a-7939a6ca1b06","Type":"ContainerDied","Data":"19becdde2b4e014b903b38ed95faa546d5c2a553bbbafc8255e59f3b2daecab2"}
Oct 30 22:22:54.618334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.617811    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"
Oct 30 22:22:54.618334 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.617867    5579 scope.go:122] "RemoveContainer" containerID="8af9a1e14284a9bda4d40ed56b5baafcb1ace643ff11d4dda58addc53335762f"
Oct 30 22:22:54.619446 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.619428    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"
Oct 30 22:22:54.619574 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.619445    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc" event={"ID":"360f4fbf-165a-4191-ab61-8d32c468d759","Type":"ContainerDied","Data":"356a9fd0618a22e63b24b66c643985124af6a61a4957bd036ccb49d7a5c006f7"}
Oct 30 22:22:54.621381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.621356    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54" event={"ID":"ab9868e3-6ffc-4633-945b-4b5a991853dc","Type":"ContainerDied","Data":"bef4d6a1df1c24d7160458414ca8f9bf1f922affce4be1bbf3827ff3eaac068b"}
Oct 30 22:22:54.621490 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.621387    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"
Oct 30 22:22:54.630656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.630640    5579 scope.go:122] "RemoveContainer" containerID="1fcc2d29b6fac8d67f747accc51de30c5a8d3ee03a0723686f8f569881eeb146"
Oct 30 22:22:54.640205 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.640177    5579 scope.go:122] "RemoveContainer" containerID="5722e828ca39f60a20b09789e34b8f0a58b283a6ea14055263430599781a56f5"
Oct 30 22:22:54.822807 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.822719    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:22:54.867724 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.867690    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-7fstr"]
Oct 30 22:22:54.971715 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.971684    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:22:54.977146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:54.977118    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-srtrc"]
Oct 30 22:22:55.080425 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:55.080336    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:22:55.088535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:55.088499    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-778d39d3-openshift-default-bff74755c-thz54"]
Oct 30 22:22:55.147457 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:55.147424    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" path="/var/lib/kubelet/pods/360f4fbf-165a-4191-ab61-8d32c468d759/volumes"
Oct 30 22:22:55.148003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:55.147983    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" path="/var/lib/kubelet/pods/ab9868e3-6ffc-4633-945b-4b5a991853dc/volumes"
Oct 30 22:22:55.148484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:22:55.148466    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" path="/var/lib/kubelet/pods/bbf48e57-3c4e-41d2-b28a-7939a6ca1b06/volumes"
Oct 30 22:23:02.426677 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.426610    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main" containerID="cri-o://0785aef088fc818bbf6c0d2ce9541612d25a862a2cd8acb60e821ad536183bc1" gracePeriod=45
Oct 30 22:23:02.678760 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.678681    5579 generic.go:356] "Generic (PLEG): container finished" podID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerID="0785aef088fc818bbf6c0d2ce9541612d25a862a2cd8acb60e821ad536183bc1" exitCode=0
Oct 30 22:23:02.678903 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.678751    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" event={"ID":"a6057361-a85b-4e03-8a06-da6ed1349f24","Type":"ContainerDied","Data":"0785aef088fc818bbf6c0d2ce9541612d25a862a2cd8acb60e821ad536183bc1"}
Oct 30 22:23:02.700690 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.700659    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:23:02.781309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781269    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781311    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\" (UniqueName: \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781418    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781535 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781491    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781535    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781656 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781603    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\") pod \"a6057361-a85b-4e03-8a06-da6ed1349f24\" (UID: \"a6057361-a85b-4e03-8a06-da6ed1349f24\") "
Oct 30 22:23:02.781768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781671    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:02.781824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781773    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:02.781878 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.781830    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:02.782118 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.782095    5579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-home\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:02.782118 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.782119    5579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-tmp-dir\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:02.782299 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.782133    5579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-model-cache\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:02.783811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.783775    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:02.783967 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.783846    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "kube-api-access-g2vh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:02.783967 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.783847    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm" pod "a6057361-a85b-4e03-8a06-da6ed1349f24" (UID: "a6057361-a85b-4e03-8a06-da6ed1349f24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:02.883802 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.883756    5579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6057361-a85b-4e03-8a06-da6ed1349f24-dshm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:02.883802 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.883795    5579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6057361-a85b-4e03-8a06-da6ed1349f24-tls-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:02.884040 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:02.883811    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2vh8\" (UniqueName: \"kubernetes.io/projected/a6057361-a85b-4e03-8a06-da6ed1349f24-kube-api-access-g2vh8\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:03.686689 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:03.686651    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446" event={"ID":"a6057361-a85b-4e03-8a06-da6ed1349f24","Type":"ContainerDied","Data":"6169798a3f28965753b0bf16fb3fad75caa76e13c0a052ee4cd5c8ecb770d653"}
Oct 30 22:23:03.687160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:03.686708    5579 scope.go:122] "RemoveContainer" containerID="0785aef088fc818bbf6c0d2ce9541612d25a862a2cd8acb60e821ad536183bc1"
Oct 30 22:23:03.687160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:03.686669    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"
Oct 30 22:23:03.841261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:03.841221    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:23:03.887095 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:03.887060    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-5be0d1/distinct-2-w2-5be0d1-kserve-7bf48d64df-5w446"]
Oct 30 22:23:04.310519 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.310480    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:23:04.310764 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.310720    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" podUID="3d3fa597-4805-4560-9ed1-e61476bfab60" containerName="maas-api" containerID="cri-o://2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52" gracePeriod=30
Oct 30 22:23:04.607908 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.607875    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:23:04.700800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.700445    5579 generic.go:356] "Generic (PLEG): container finished" podID="3d3fa597-4805-4560-9ed1-e61476bfab60" containerID="2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52" exitCode=0
Oct 30 22:23:04.700800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.700512    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"
Oct 30 22:23:04.700800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.700629    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" event={"ID":"3d3fa597-4805-4560-9ed1-e61476bfab60","Type":"ContainerDied","Data":"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"}
Oct 30 22:23:04.700800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.700676    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2" event={"ID":"3d3fa597-4805-4560-9ed1-e61476bfab60","Type":"ContainerDied","Data":"af32f3b4fdf6c777671f1f4e7c3d2be3a169825a245a4a36c0c48700791eef98"}
Oct 30 22:23:04.700800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.700694    5579 scope.go:122] "RemoveContainer" containerID="2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"
Oct 30 22:23:04.704787 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.704738    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\") pod \"3d3fa597-4805-4560-9ed1-e61476bfab60\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") "
Oct 30 22:23:04.705010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.704854    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\") pod \"3d3fa597-4805-4560-9ed1-e61476bfab60\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") "
Oct 30 22:23:04.705010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.704903    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") pod \"3d3fa597-4805-4560-9ed1-e61476bfab60\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") "
Oct 30 22:23:04.705652 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.705018    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\" (UniqueName: \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\") pod \"3d3fa597-4805-4560-9ed1-e61476bfab60\" (UID: \"3d3fa597-4805-4560-9ed1-e61476bfab60\") "
Oct 30 22:23:04.705746 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.705720    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca" pod "3d3fa597-4805-4560-9ed1-e61476bfab60" (UID: "3d3fa597-4805-4560-9ed1-e61476bfab60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:04.709419 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.709375    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc" pod "3d3fa597-4805-4560-9ed1-e61476bfab60" (UID: "3d3fa597-4805-4560-9ed1-e61476bfab60"). InnerVolumeSpecName "kube-api-access-f2spc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:04.711467 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.711442    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs" pod "3d3fa597-4805-4560-9ed1-e61476bfab60" (UID: "3d3fa597-4805-4560-9ed1-e61476bfab60"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:04.725173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.721553    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls" pod "3d3fa597-4805-4560-9ed1-e61476bfab60" (UID: "3d3fa597-4805-4560-9ed1-e61476bfab60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:04.755924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.755585    5579 scope.go:122] "RemoveContainer" containerID="2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"
Oct 30 22:23:04.756079 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:04.756012    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52\": container with ID starting with 2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52 not found: ID does not exist" containerID="2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"
Oct 30 22:23:04.756079 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.756054    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52"} err="failed to get container status \"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52\": rpc error: code = NotFound desc = could not find container \"2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52\": container with ID starting with 2f57a0ecc29ebe62f28875afc94d776f6dc4289134573d28310f39eea5d8fc52 not found: ID does not exist"
Oct 30 22:23:04.806990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.806918    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2spc\" (UniqueName: \"kubernetes.io/projected/3d3fa597-4805-4560-9ed1-e61476bfab60-kube-api-access-f2spc\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:04.806990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.806990    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3fa597-4805-4560-9ed1-e61476bfab60-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:04.806990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.807009    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:04.807243 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:04.807022    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d3fa597-4805-4560-9ed1-e61476bfab60-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:05.127270 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:05.127233    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:23:05.147069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:05.147033    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" path="/var/lib/kubelet/pods/a6057361-a85b-4e03-8a06-da6ed1349f24/volumes"
Oct 30 22:23:05.174835 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:05.174802    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ce563-5f8b4bbb86-5j6b2"]
Oct 30 22:23:07.146570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:07.146533    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d3fa597-4805-4560-9ed1-e61476bfab60" path="/var/lib/kubelet/pods/3d3fa597-4805-4560-9ed1-e61476bfab60/volumes"
Oct 30 22:23:12.929977 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:12.929941    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:23:26.012519 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:26.012486    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:23:26.013046 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:26.013017    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:23:26.188953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:26.188030    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:23:26.188953 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:26.188095    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:23:30.160286 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:30.160253    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:23:30.206344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:30.206307    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 22:23:31.403975 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.403941    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:23:31.404473 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404456    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404474    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404485    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404490    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404501    5579 cpu_manager.go:414] "containerMap: removing container" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404507    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy"
Oct 30 22:23:31.404520 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404520    5579 cpu_manager.go:414] "containerMap: removing container" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404526    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404533    5579 cpu_manager.go:414] "containerMap: removing container" podUID="3d3fa597-4805-4560-9ed1-e61476bfab60" containerName="maas-api"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404537    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d3fa597-4805-4560-9ed1-e61476bfab60" containerName="maas-api"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404547    5579 cpu_manager.go:414] "containerMap: removing container" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404552    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404582    5579 cpu_manager.go:414] "containerMap: removing container" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404590    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404685    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="360f4fbf-165a-4191-ab61-8d32c468d759" containerName="istio-proxy"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404697    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6057361-a85b-4e03-8a06-da6ed1349f24" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404705    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbf48e57-3c4e-41d2-b28a-7939a6ca1b06" containerName="istio-proxy"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404710    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d3fa597-4805-4560-9ed1-e61476bfab60" containerName="maas-api"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404716    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b8fa0de-0861-4b87-96eb-5d2641752395" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404722    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab9268e2-6e2e-4ed6-9730-43e136c37e4b" containerName="main"
Oct 30 22:23:31.404728 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.404728    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab9868e3-6ffc-4633-945b-4b5a991853dc" containerName="istio-proxy"
Oct 30 22:23:31.408186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.408166    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483564    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483631    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483704    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483765    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsznk\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483827    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.483907 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483887    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.484003 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.483906    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.484074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.484060    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.484142 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.484085    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.510515 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.510479    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:23:31.555967 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.555900    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c1e2ab-openshift-default-dockercfg-rh8s2\""
Oct 30 22:23:31.584837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.584802    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.584837 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.584837    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.584867    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.584923    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.584973    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585011    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsznk\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585034    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585091    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585421 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585379    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585436    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585484 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585467    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585567 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585479    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.585723 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.585706    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.586186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.586164    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.587717 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.587698    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.587839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.587820    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.639120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.639085    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.639352 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.639335    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsznk\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\") pod \"e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") " pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.721880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.721788    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:31.933279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.932982    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:23:31.933486 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:31.933257    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" containerID="cri-o://1eb86a61406c90b634f5ef418c1aa288f1d2d5824a1eeea203a248fc424c65b0" gracePeriod=30
Oct 30 22:23:32.141653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.141616    5579 patch_prober.go:29] interesting pod/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:23:32.141824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.141684    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:23:32.150291 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.150262    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:23:32.155750 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:23:32.155712    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec12dda_9fe5_4bfa_9d7b_f818099bbf7b.slice/crio-cddd6a56b3bebb47032120b69537b486cef142fa15ed3c664bd31a84eba796dc WatchSource:0}: Error finding container cddd6a56b3bebb47032120b69537b486cef142fa15ed3c664bd31a84eba796dc: Status 404 returned error can't find the container with id cddd6a56b3bebb47032120b69537b486cef142fa15ed3c664bd31a84eba796dc
Oct 30 22:23:32.158215 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.158181    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:23:32.158307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.158250    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:23:32.158307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.158281    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:23:32.648081 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.648007    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 22:23:32.648663 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.648273    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy" containerID="cri-o://e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41" gracePeriod=30
Oct 30 22:23:32.959977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.959879    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" event={"ID":"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b","Type":"ContainerStarted","Data":"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"}
Oct 30 22:23:32.959977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:32.959962    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" event={"ID":"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b","Type":"ContainerStarted","Data":"cddd6a56b3bebb47032120b69537b486cef142fa15ed3c664bd31a84eba796dc"}
Oct 30 22:23:33.075880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:33.075821    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podStartSLOduration=2.075806368 podStartE2EDuration="2.075806368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:33.073149722 +0000 UTC m=+2418.042996131" watchObservedRunningTime="2026-10-30 22:23:33.075806368 +0000 UTC m=+2418.045652777"
Oct 30 22:23:33.743955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:33.737122    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:33.743955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:33.738775    5579 patch_prober.go:29] interesting pod/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:23:33.743955 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:33.738829    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 22:23:34.742954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:34.736162    5579 patch_prober.go:29] interesting pod/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:23:34.742954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:34.736229    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 22:23:35.742954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:35.735358    5579 patch_prober.go:29] interesting pod/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:23:35.742954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:35.735461    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 22:23:36.739098 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:36.736858    5579 patch_prober.go:29] interesting pod/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:23:36.739098 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:36.736920    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 22:23:36.986679 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:36.986636    5579 generic.go:356] "Generic (PLEG): container finished" podID="6052ef14-3607-43d5-977a-5689d42faebe" containerID="1eb86a61406c90b634f5ef418c1aa288f1d2d5824a1eeea203a248fc424c65b0" exitCode=0
Oct 30 22:23:36.987113 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:36.986712    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" event={"ID":"6052ef14-3607-43d5-977a-5689d42faebe","Type":"ContainerDied","Data":"1eb86a61406c90b634f5ef418c1aa288f1d2d5824a1eeea203a248fc424c65b0"}
Oct 30 22:23:37.660421 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.660387    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:23:37.747014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.742392    5579 patch_prober.go:29] interesting pod/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:23:37.747014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.742453    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 22:23:37.776734 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.776699    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.776910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.776770    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.776910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.776848    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777144 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.776908    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777144 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.776958    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777144 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777007    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777144 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777124    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777147    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777181    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\") pod \"6052ef14-3607-43d5-977a-5689d42faebe\" (UID: \"6052ef14-3607-43d5-977a-5689d42faebe\") "
Oct 30 22:23:37.777413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777270    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:37.777413 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777382    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:37.777635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777554    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:37.777762 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777728    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:37.777870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777782    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6052ef14-3607-43d5-977a-5689d42faebe-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.777870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777826    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.777870 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.777842    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.778895 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.778186    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:37.779666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.779620    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:37.779997 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.779973    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:37.780101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.779993    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:37.781242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.781222    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8" pod "6052ef14-3607-43d5-977a-5689d42faebe" (UID: "6052ef14-3607-43d5-977a-5689d42faebe"). InnerVolumeSpecName "kube-api-access-sz4v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:37.879297 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879260    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.879297 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879301    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.879575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879317    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz4v8\" (UniqueName: \"kubernetes.io/projected/6052ef14-3607-43d5-977a-5689d42faebe-kube-api-access-sz4v8\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.879575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879331    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.879575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879347    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6052ef14-3607-43d5-977a-5689d42faebe-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.879575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.879389    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6052ef14-3607-43d5-977a-5689d42faebe-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:37.910298 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.910271    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 22:23:37.996356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.996326    5579 generic.go:356] "Generic (PLEG): container finished" podID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerID="e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41" exitCode=0
Oct 30 22:23:37.996829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.996382    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"
Oct 30 22:23:37.996829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.996402    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" event={"ID":"5a1f58c7-c792-45b0-b9e8-81725268dd74","Type":"ContainerDied","Data":"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"}
Oct 30 22:23:37.996829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.996465    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm" event={"ID":"5a1f58c7-c792-45b0-b9e8-81725268dd74","Type":"ContainerDied","Data":"1c47a2fc2f998a1483835699f0f689dbd2879eaf38c0babed6b9b33d855dbdd3"}
Oct 30 22:23:37.996829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.996499    5579 scope.go:122] "RemoveContainer" containerID="e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"
Oct 30 22:23:37.998078 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.998054    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"
Oct 30 22:23:37.998192 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:37.998099    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv" event={"ID":"6052ef14-3607-43d5-977a-5689d42faebe","Type":"ContainerDied","Data":"b525c1e45452c1e1e160b889aa27ceaf52f8af3446de3a76bb176a904a7503a0"}
Oct 30 22:23:38.008366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.008349    5579 scope.go:122] "RemoveContainer" containerID="e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"
Oct 30 22:23:38.008627 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:38.008603    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41\": container with ID starting with e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41 not found: ID does not exist" containerID="e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"
Oct 30 22:23:38.008700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.008635    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41"} err="failed to get container status \"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41\": rpc error: code = NotFound desc = could not find container \"e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41\": container with ID starting with e1cd79bfa232e344caa6107e40d9f15d8d16d05e7ad55f3b6a1778b5b16f5f41 not found: ID does not exist"
Oct 30 22:23:38.008700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.008652    5579 scope.go:122] "RemoveContainer" containerID="1eb86a61406c90b634f5ef418c1aa288f1d2d5824a1eeea203a248fc424c65b0"
Oct 30 22:23:38.080991 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.080958    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081019    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081055    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081179 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081135    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081197    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081253    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081362    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081399    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.081557 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.081449    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\") pod \"5a1f58c7-c792-45b0-b9e8-81725268dd74\" (UID: \"5a1f58c7-c792-45b0-b9e8-81725268dd74\") "
Oct 30 22:23:38.083330 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.083149    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:38.083707 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.083515    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:38.084115 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.084009    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:38.084234 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.084213    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:38.084419 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.084378    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:38.084513 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.084492    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:38.085261 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.085237    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:38.085772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.085746    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:38.086054 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.086032    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s" pod "5a1f58c7-c792-45b0-b9e8-81725268dd74" (UID: "5a1f58c7-c792-45b0-b9e8-81725268dd74"). InnerVolumeSpecName "kube-api-access-mhf5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:38.183325 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183290    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183325 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183319    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhf5s\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-kube-api-access-mhf5s\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183325 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183330    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183339    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1f58c7-c792-45b0-b9e8-81725268dd74-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183347    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183358    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183367    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183375    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1f58c7-c792-45b0-b9e8-81725268dd74-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.183556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.183385    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1f58c7-c792-45b0-b9e8-81725268dd74-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:38.231165 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.231127    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:23:38.240144 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.240108    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5402dd-openshift-default-f6ff5b9d5-ptqrv"]
Oct 30 22:23:38.411879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.411174    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 22:23:38.420672 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.420634    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2d1f91-openshift-default-7967f7cd55-6grpm"]
Oct 30 22:23:38.727682 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.727644    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:38.728012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.727987    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:38.728700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:38.728684    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:23:39.145947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:39.145889    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" path="/var/lib/kubelet/pods/5a1f58c7-c792-45b0-b9e8-81725268dd74/volumes"
Oct 30 22:23:39.146562 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:39.146542    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6052ef14-3607-43d5-977a-5689d42faebe" path="/var/lib/kubelet/pods/6052ef14-3607-43d5-977a-5689d42faebe/volumes"
Oct 30 22:23:42.930106 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:42.930072    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:23:45.181488 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.181447    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main" containerID="cri-o://068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d" gracePeriod=45
Oct 30 22:23:45.226779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.226738    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main" containerID="cri-o://b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff" gracePeriod=45
Oct 30 22:23:45.495815 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.495787    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:23:45.516897 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.516875    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:23:45.558431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558397    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\" (UniqueName: \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.558617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558450    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.558617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558479    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.558617 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558578    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.558805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558623    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\" (UniqueName: \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.558805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558656    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.558805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558715    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\" (UniqueName: \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.558805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558734    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.558805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558791    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.559093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558820    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.559093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558865    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.559093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558905    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.559093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.558974    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\") pod \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\" (UID: \"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b\") "
Oct 30 22:23:45.559093 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559004    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\") pod \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\" (UID: \"887e1fb1-5161-4ab2-a26c-0ec95b3dd229\") "
Oct 30 22:23:45.559359 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559144    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.559359 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559347    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.559512 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559496    5579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-home\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.559575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559543    5579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tmp-dir\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.559575 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559560    5579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-model-cache\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.559686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559498    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.559686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559576    5579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-home\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.559686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.559544    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.561233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561191    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.561345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561285    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:45.561345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561298    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:45.561345 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561304    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2" pod "887e1fb1-5161-4ab2-a26c-0ec95b3dd229" (UID: "887e1fb1-5161-4ab2-a26c-0ec95b3dd229"). InnerVolumeSpecName "kube-api-access-5lhv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:45.561596 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561579    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:45.561658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.561631    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9" pod "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" (UID: "cc45c9a2-f318-4783-bafc-0ddebb0c6d2b"). InnerVolumeSpecName "kube-api-access-bszw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:45.661001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.660963    5579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tmp-dir\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.660999    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lhv2\" (UniqueName: \"kubernetes.io/projected/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-kube-api-access-5lhv2\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661001 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661011    5579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-dshm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661020    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszw9\" (UniqueName: \"kubernetes.io/projected/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-kube-api-access-bszw9\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661037    5579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-dshm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661045    5579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887e1fb1-5161-4ab2-a26c-0ec95b3dd229-tls-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661054    5579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-model-cache\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:45.661242 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:45.661063    5579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b-tls-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:23:46.056710 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.056670    5579 generic.go:356] "Generic (PLEG): container finished" podID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerID="b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff" exitCode=0
Oct 30 22:23:46.056920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.056731    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"
Oct 30 22:23:46.056920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.056750    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" event={"ID":"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b","Type":"ContainerDied","Data":"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"}
Oct 30 22:23:46.056920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.056818    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf" event={"ID":"cc45c9a2-f318-4783-bafc-0ddebb0c6d2b","Type":"ContainerDied","Data":"f77d0d6d3b59b671b1b8ff3b9ab8784b8050f417d8cbcd72aff49d995fe8f1e1"}
Oct 30 22:23:46.056920 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.056843    5579 scope.go:122] "RemoveContainer" containerID="b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"
Oct 30 22:23:46.060978 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.060802    5579 generic.go:356] "Generic (PLEG): container finished" podID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerID="068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d" exitCode=0
Oct 30 22:23:46.061120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.060989    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"
Oct 30 22:23:46.061120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.061003    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" event={"ID":"887e1fb1-5161-4ab2-a26c-0ec95b3dd229","Type":"ContainerDied","Data":"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"}
Oct 30 22:23:46.061120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.061035    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h" event={"ID":"887e1fb1-5161-4ab2-a26c-0ec95b3dd229","Type":"ContainerDied","Data":"99798d4925663bda8f6bcbc5d424612cf59f5a854762111ffb9565ba653f7ab7"}
Oct 30 22:23:46.069526 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.069505    5579 scope.go:122] "RemoveContainer" containerID="b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"
Oct 30 22:23:46.069809 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:46.069789    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff\": container with ID starting with b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff not found: ID does not exist" containerID="b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"
Oct 30 22:23:46.069957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.069814    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff"} err="failed to get container status \"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff\": rpc error: code = NotFound desc = could not find container \"b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff\": container with ID starting with b2db0d7778dee176bafc4de86c6a09167b7b6c6b6ecd55737be80fbf08b443ff not found: ID does not exist"
Oct 30 22:23:46.069957 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.069832    5579 scope.go:122] "RemoveContainer" containerID="068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"
Oct 30 22:23:46.078583 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.078563    5579 scope.go:122] "RemoveContainer" containerID="068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"
Oct 30 22:23:46.078919 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:23:46.078901    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d\": container with ID starting with 068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d not found: ID does not exist" containerID="068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"
Oct 30 22:23:46.078996 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.078939    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d"} err="failed to get container status \"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d\": rpc error: code = NotFound desc = could not find container \"068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d\": container with ID starting with 068f909d60a6b4e18e10d59c0e8402d8700248a18452e85d3100d8a4bdd8469d not found: ID does not exist"
Oct 30 22:23:46.209668 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.209638    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:23:46.215257 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.215226    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-2-w0-2d1f91-kserve-65758b4b45-f4w2h"]
Oct 30 22:23:46.317327 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.317249    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 22:23:46.325871 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:46.325842    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2d1f91/distinct-w0-2d1f91-kserve-588466d966-lqgmf"]
Oct 30 22:23:47.146467 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:47.146436    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" path="/var/lib/kubelet/pods/887e1fb1-5161-4ab2-a26c-0ec95b3dd229/volumes"
Oct 30 22:23:47.146864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:23:47.146851    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" path="/var/lib/kubelet/pods/cc45c9a2-f318-4783-bafc-0ddebb0c6d2b/volumes"
Oct 30 22:24:11.176337 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.176246    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 22:24:11.176813 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.176500    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" podUID="fb242fc4-737b-42aa-b1da-de7734c10151" containerName="maas-api" containerID="cri-o://8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a" gracePeriod=30
Oct 30 22:24:11.453027 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.452999    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 22:24:11.544890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.544854    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\" (UniqueName: \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\") pod \"fb242fc4-737b-42aa-b1da-de7734c10151\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") "
Oct 30 22:24:11.545089 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.545050    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\") pod \"fb242fc4-737b-42aa-b1da-de7734c10151\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") "
Oct 30 22:24:11.545151 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.545117    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") pod \"fb242fc4-737b-42aa-b1da-de7734c10151\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") "
Oct 30 22:24:11.545201 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.545161    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\") pod \"fb242fc4-737b-42aa-b1da-de7734c10151\" (UID: \"fb242fc4-737b-42aa-b1da-de7734c10151\") "
Oct 30 22:24:11.545772 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.545726    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca" pod "fb242fc4-737b-42aa-b1da-de7734c10151" (UID: "fb242fc4-737b-42aa-b1da-de7734c10151"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:11.548082 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.548034    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r" pod "fb242fc4-737b-42aa-b1da-de7734c10151" (UID: "fb242fc4-737b-42aa-b1da-de7734c10151"). InnerVolumeSpecName "kube-api-access-8w84r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:11.548612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.548589    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls" pod "fb242fc4-737b-42aa-b1da-de7734c10151" (UID: "fb242fc4-737b-42aa-b1da-de7734c10151"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:11.573635 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.571861    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs" pod "fb242fc4-737b-42aa-b1da-de7734c10151" (UID: "fb242fc4-737b-42aa-b1da-de7734c10151"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:11.647192 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.647156    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:11.647192 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.647188    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb242fc4-737b-42aa-b1da-de7734c10151-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:11.647192 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.647200    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb242fc4-737b-42aa-b1da-de7734c10151-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:11.647462 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:11.647210    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w84r\" (UniqueName: \"kubernetes.io/projected/fb242fc4-737b-42aa-b1da-de7734c10151-kube-api-access-8w84r\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:12.214846 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.214813    5579 generic.go:356] "Generic (PLEG): container finished" podID="fb242fc4-737b-42aa-b1da-de7734c10151" containerID="8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a" exitCode=0
Oct 30 22:24:12.215356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.214863    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"
Oct 30 22:24:12.215517 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.214867    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" event={"ID":"fb242fc4-737b-42aa-b1da-de7734c10151","Type":"ContainerDied","Data":"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"}
Oct 30 22:24:12.215517 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.215488    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg" event={"ID":"fb242fc4-737b-42aa-b1da-de7734c10151","Type":"ContainerDied","Data":"63ed69a726c02b6f389c353d01287745a7e6dc083d92208edfcccfb517329377"}
Oct 30 22:24:12.215658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.215527    5579 scope.go:122] "RemoveContainer" containerID="8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"
Oct 30 22:24:12.233327 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.233300    5579 scope.go:122] "RemoveContainer" containerID="8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"
Oct 30 22:24:12.233705 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:24:12.233674    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a\": container with ID starting with 8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a not found: ID does not exist" containerID="8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"
Oct 30 22:24:12.233810 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.233716    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a"} err="failed to get container status \"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a\": rpc error: code = NotFound desc = could not find container \"8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a\": container with ID starting with 8ebb6840bb14f6fda02517fbfd0542d42041fbfa3c372e569cb5fa4394af8b7a not found: ID does not exist"
Oct 30 22:24:12.368993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.368961    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 22:24:12.415375 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:12.415343    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a07620-6fc664d98b-4vprg"]
Oct 30 22:24:12.930280 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:24:12.930243    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:24:13.146429 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:13.146398    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb242fc4-737b-42aa-b1da-de7734c10151" path="/var/lib/kubelet/pods/fb242fc4-737b-42aa-b1da-de7734c10151/volumes"
Oct 30 22:24:20.529487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:20.529452    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 22:24:20.529964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:20.529650    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy" containerID="cri-o://f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4" gracePeriod=30
Oct 30 22:24:25.800025 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.799959    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 22:24:25.898702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898667    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.898901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898733    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.898901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898771    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.898901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898820    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.898901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898857    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.898901 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898877    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.899227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898950    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.899227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.898985    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.899227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899020    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\") pod \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\" (UID: \"845c9a0b-5670-46a0-b2bc-2e8504615dbd\") "
Oct 30 22:24:25.899227 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899042    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:25.899454 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899273    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:25.899454 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899294    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:25.899454 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899310    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:25.899616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899479    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:25.899616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899502    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:25.899616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899518    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:25.899616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899531    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:25.899616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.899478    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:25.901096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.901068    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:25.901271 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.901241    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:25.901366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.901271    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "kube-api-access-jhp68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:25.901366 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:25.901283    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token" pod "845c9a0b-5670-46a0-b2bc-2e8504615dbd" (UID: "845c9a0b-5670-46a0-b2bc-2e8504615dbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:26.000613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.000574    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:26.000613 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.000615    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:26.000856 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.000630    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:26.000856 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.000645    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/845c9a0b-5670-46a0-b2bc-2e8504615dbd-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:26.000856 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.000659    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhp68\" (UniqueName: \"kubernetes.io/projected/845c9a0b-5670-46a0-b2bc-2e8504615dbd-kube-api-access-jhp68\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:26.303556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.303520    5579 generic.go:356] "Generic (PLEG): container finished" podID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerID="f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4" exitCode=0
Oct 30 22:24:26.303745 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.303573    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"
Oct 30 22:24:26.303745 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.303587    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" event={"ID":"845c9a0b-5670-46a0-b2bc-2e8504615dbd","Type":"ContainerDied","Data":"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"}
Oct 30 22:24:26.303745 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.303639    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf" event={"ID":"845c9a0b-5670-46a0-b2bc-2e8504615dbd","Type":"ContainerDied","Data":"1adc2513c961a7e003a058288ea303c00adf7fbc56ceee0346e8ae3973a15461"}
Oct 30 22:24:26.303745 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.303668    5579 scope.go:122] "RemoveContainer" containerID="f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"
Oct 30 22:24:26.314197 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.314179    5579 scope.go:122] "RemoveContainer" containerID="f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"
Oct 30 22:24:26.314510 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:24:26.314486    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4\": container with ID starting with f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4 not found: ID does not exist" containerID="f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"
Oct 30 22:24:26.314588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.314518    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4"} err="failed to get container status \"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4\": rpc error: code = NotFound desc = could not find container \"f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4\": container with ID starting with f02d2c5fd1aec1f86cfdc18d6922543add61257c2f5cce328b862248dc93bbc4 not found: ID does not exist"
Oct 30 22:24:26.457115 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.457079    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 22:24:26.503363 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:26.503327    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a07620-openshift-default-8d8c5c5b7-2g6xf"]
Oct 30 22:24:27.146779 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:27.146749    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" path="/var/lib/kubelet/pods/845c9a0b-5670-46a0-b2bc-2e8504615dbd/volumes"
Oct 30 22:24:42.929484 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:24:42.929445    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:24:43.264158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.264068    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 22:24:43.264356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.264324    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" podUID="cbf97f98-274f-4242-beee-e462faa43e7a" containerName="maas-api" containerID="cri-o://1620b4173aae3f62f5d64da957ffde25a15f47fe9154a0df9bd26e0952a6baeb" gracePeriod=30
Oct 30 22:24:43.402631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.402596    5579 generic.go:356] "Generic (PLEG): container finished" podID="cbf97f98-274f-4242-beee-e462faa43e7a" containerID="1620b4173aae3f62f5d64da957ffde25a15f47fe9154a0df9bd26e0952a6baeb" exitCode=0
Oct 30 22:24:43.402819 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.402659    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" event={"ID":"cbf97f98-274f-4242-beee-e462faa43e7a","Type":"ContainerDied","Data":"1620b4173aae3f62f5d64da957ffde25a15f47fe9154a0df9bd26e0952a6baeb"}
Oct 30 22:24:43.555753 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.555719    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 22:24:43.692374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.691444    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") pod \"cbf97f98-274f-4242-beee-e462faa43e7a\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") "
Oct 30 22:24:43.692374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.691534    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\" (UniqueName: \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\") pod \"cbf97f98-274f-4242-beee-e462faa43e7a\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") "
Oct 30 22:24:43.692374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.691692    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\") pod \"cbf97f98-274f-4242-beee-e462faa43e7a\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") "
Oct 30 22:24:43.692374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.691737    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\") pod \"cbf97f98-274f-4242-beee-e462faa43e7a\" (UID: \"cbf97f98-274f-4242-beee-e462faa43e7a\") "
Oct 30 22:24:43.692374 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.692326    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca" pod "cbf97f98-274f-4242-beee-e462faa43e7a" (UID: "cbf97f98-274f-4242-beee-e462faa43e7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:43.694597 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.694544    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq" pod "cbf97f98-274f-4242-beee-e462faa43e7a" (UID: "cbf97f98-274f-4242-beee-e462faa43e7a"). InnerVolumeSpecName "kube-api-access-b86mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:43.698106 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.698067    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs" pod "cbf97f98-274f-4242-beee-e462faa43e7a" (UID: "cbf97f98-274f-4242-beee-e462faa43e7a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:43.698106 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.698088    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls" pod "cbf97f98-274f-4242-beee-e462faa43e7a" (UID: "cbf97f98-274f-4242-beee-e462faa43e7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:43.793361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.793281    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:43.793361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.793311    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbf97f98-274f-4242-beee-e462faa43e7a-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:43.793361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.793323    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b86mq\" (UniqueName: \"kubernetes.io/projected/cbf97f98-274f-4242-beee-e462faa43e7a-kube-api-access-b86mq\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:43.793361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:43.793333    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf97f98-274f-4242-beee-e462faa43e7a-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:24:44.409491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:44.409458    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"
Oct 30 22:24:44.410033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:44.409482    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw" event={"ID":"cbf97f98-274f-4242-beee-e462faa43e7a","Type":"ContainerDied","Data":"f97ffcd71a229095e10d55ef522bf508f41ffc272a47d782feb93bbd56c95240"}
Oct 30 22:24:44.410033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:44.409549    5579 scope.go:122] "RemoveContainer" containerID="1620b4173aae3f62f5d64da957ffde25a15f47fe9154a0df9bd26e0952a6baeb"
Oct 30 22:24:44.563757 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:44.563712    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 22:24:44.567012 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:44.566983    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-5be0d1-847f496958-rsstw"]
Oct 30 22:24:45.145852 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:24:45.145814    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbf97f98-274f-4242-beee-e462faa43e7a" path="/var/lib/kubelet/pods/cbf97f98-274f-4242-beee-e462faa43e7a/volumes"
Oct 30 22:25:09.680738 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:09.680700    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 22:25:09.681309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:09.680905    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" podUID="c82ce272-d654-4505-b3e3-b912bdf3d10b" containerName="maas-api" containerID="cri-o://0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1" gracePeriod=30
Oct 30 22:25:09.977470 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:09.977441    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 22:25:10.108798 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.108768    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") pod \"c82ce272-d654-4505-b3e3-b912bdf3d10b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") "
Oct 30 22:25:10.109014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.108815    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\") pod \"c82ce272-d654-4505-b3e3-b912bdf3d10b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") "
Oct 30 22:25:10.109014 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.108854    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\") pod \"c82ce272-d654-4505-b3e3-b912bdf3d10b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") "
Oct 30 22:25:10.109507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.108910    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\" (UniqueName: \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\") pod \"c82ce272-d654-4505-b3e3-b912bdf3d10b\" (UID: \"c82ce272-d654-4505-b3e3-b912bdf3d10b\") "
Oct 30 22:25:10.109507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.109264    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca" pod "c82ce272-d654-4505-b3e3-b912bdf3d10b" (UID: "c82ce272-d654-4505-b3e3-b912bdf3d10b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:10.109748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.109703    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c82ce272-d654-4505-b3e3-b912bdf3d10b-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:10.111640 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.111597    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls" pod "c82ce272-d654-4505-b3e3-b912bdf3d10b" (UID: "c82ce272-d654-4505-b3e3-b912bdf3d10b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:10.112168 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.112137    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs" pod "c82ce272-d654-4505-b3e3-b912bdf3d10b" (UID: "c82ce272-d654-4505-b3e3-b912bdf3d10b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:10.113230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.113200    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772" pod "c82ce272-d654-4505-b3e3-b912bdf3d10b" (UID: "c82ce272-d654-4505-b3e3-b912bdf3d10b"). InnerVolumeSpecName "kube-api-access-tj772". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:10.210670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.210579    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj772\" (UniqueName: \"kubernetes.io/projected/c82ce272-d654-4505-b3e3-b912bdf3d10b-kube-api-access-tj772\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:10.210670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.210617    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:10.210670 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.210632    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c82ce272-d654-4505-b3e3-b912bdf3d10b-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:10.623666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.623540    5579 generic.go:356] "Generic (PLEG): container finished" podID="c82ce272-d654-4505-b3e3-b912bdf3d10b" containerID="0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1" exitCode=0
Oct 30 22:25:10.623666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.623603    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"
Oct 30 22:25:10.624064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.623693    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" event={"ID":"c82ce272-d654-4505-b3e3-b912bdf3d10b","Type":"ContainerDied","Data":"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"}
Oct 30 22:25:10.624064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.623764    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b" event={"ID":"c82ce272-d654-4505-b3e3-b912bdf3d10b","Type":"ContainerDied","Data":"ec28695a086f71406adee459653d0c0dade1441fab9df09c16e797ec88870655"}
Oct 30 22:25:10.624064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.623795    5579 scope.go:122] "RemoveContainer" containerID="0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"
Oct 30 22:25:10.638977 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.638917    5579 scope.go:122] "RemoveContainer" containerID="0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"
Oct 30 22:25:10.639353 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:25:10.639331    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1\": container with ID starting with 0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1 not found: ID does not exist" containerID="0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"
Oct 30 22:25:10.639445 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.639368    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1"} err="failed to get container status \"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1\": rpc error: code = NotFound desc = could not find container \"0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1\": container with ID starting with 0ce305614286909c40178343e6252af6483d295e750492dfbad05b5545fd9ed1 not found: ID does not exist"
Oct 30 22:25:10.778391 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.778339    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 22:25:10.824406 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:10.824367    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2d1f91-64464764fd-rjh9b"]
Oct 30 22:25:11.146136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:11.146097    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c82ce272-d654-4505-b3e3-b912bdf3d10b" path="/var/lib/kubelet/pods/c82ce272-d654-4505-b3e3-b912bdf3d10b/volumes"
Oct 30 22:25:12.929492 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:25:12.929455    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:25:20.998487 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:20.998453    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:25:20.998888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:20.998686    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" podUID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" containerName="maas-api" containerID="cri-o://daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9" gracePeriod=30
Oct 30 22:25:21.283958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.283912    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:25:21.430711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.430665    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\") pod \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") "
Oct 30 22:25:21.430888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.430754    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\" (UniqueName: \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\") pod \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") "
Oct 30 22:25:21.430888 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.430828    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\") pod \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") "
Oct 30 22:25:21.431020 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.430886    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") pod \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\" (UID: \"cb2a2111-4f1f-43bc-a5e4-931b2b921c71\") "
Oct 30 22:25:21.431458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.431423    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca" pod "cb2a2111-4f1f-43bc-a5e4-931b2b921c71" (UID: "cb2a2111-4f1f-43bc-a5e4-931b2b921c71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:21.431773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.431742    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:21.433795 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.433754    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls" pod "cb2a2111-4f1f-43bc-a5e4-931b2b921c71" (UID: "cb2a2111-4f1f-43bc-a5e4-931b2b921c71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:21.433981 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.433914    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs" pod "cb2a2111-4f1f-43bc-a5e4-931b2b921c71" (UID: "cb2a2111-4f1f-43bc-a5e4-931b2b921c71"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:21.435219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.435193    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7" pod "cb2a2111-4f1f-43bc-a5e4-931b2b921c71" (UID: "cb2a2111-4f1f-43bc-a5e4-931b2b921c71"). InnerVolumeSpecName "kube-api-access-ztqs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:21.533336 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.533193    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:21.533336 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.533232    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztqs7\" (UniqueName: \"kubernetes.io/projected/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-kube-api-access-ztqs7\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:21.533336 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.533249    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2a2111-4f1f-43bc-a5e4-931b2b921c71-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:21.694403 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.694365    5579 generic.go:356] "Generic (PLEG): container finished" podID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" containerID="daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9" exitCode=0
Oct 30 22:25:21.694579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.694409    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"
Oct 30 22:25:21.694579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.694441    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" event={"ID":"cb2a2111-4f1f-43bc-a5e4-931b2b921c71","Type":"ContainerDied","Data":"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"}
Oct 30 22:25:21.694579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.694492    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s" event={"ID":"cb2a2111-4f1f-43bc-a5e4-931b2b921c71","Type":"ContainerDied","Data":"f7a7ce75e7e96fda2013933ab0b0b7726e3d1c1ccfb3b06f425a10cd4facfae3"}
Oct 30 22:25:21.694579 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.694513    5579 scope.go:122] "RemoveContainer" containerID="daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"
Oct 30 22:25:21.704700 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.704678    5579 scope.go:122] "RemoveContainer" containerID="daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"
Oct 30 22:25:21.704977 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:25:21.704960    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9\": container with ID starting with daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9 not found: ID does not exist" containerID="daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"
Oct 30 22:25:21.705051 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.704985    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9"} err="failed to get container status \"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9\": rpc error: code = NotFound desc = could not find container \"daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9\": container with ID starting with daad14647e6a23dd5075b46fcfdd84e5d48dcfc6569c33c9781f2cc679b719b9 not found: ID does not exist"
Oct 30 22:25:21.853023 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.852544    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:25:21.859263 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:21.859223    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-edf6d5-7c87666df5-59b4s"]
Oct 30 22:25:23.146328 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:23.146292    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" path="/var/lib/kubelet/pods/cb2a2111-4f1f-43bc-a5e4-931b2b921c71/volumes"
Oct 30 22:25:42.315371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.315292    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 22:25:42.315973 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.315483    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" podUID="ea73b814-b74d-4992-b613-08d04dd8f097" containerName="maas-api" containerID="cri-o://ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3" gracePeriod=30
Oct 30 22:25:42.592783 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.592743    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 22:25:42.650249 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.650213    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\") pod \"ea73b814-b74d-4992-b613-08d04dd8f097\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") "
Oct 30 22:25:42.650431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.650257    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\" (UniqueName: \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\") pod \"ea73b814-b74d-4992-b613-08d04dd8f097\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") "
Oct 30 22:25:42.650431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.650292    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\") pod \"ea73b814-b74d-4992-b613-08d04dd8f097\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") "
Oct 30 22:25:42.650431 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.650375    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") pod \"ea73b814-b74d-4992-b613-08d04dd8f097\" (UID: \"ea73b814-b74d-4992-b613-08d04dd8f097\") "
Oct 30 22:25:42.650773 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.650737    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca" pod "ea73b814-b74d-4992-b613-08d04dd8f097" (UID: "ea73b814-b74d-4992-b613-08d04dd8f097"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:42.652556 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.652527    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs" pod "ea73b814-b74d-4992-b613-08d04dd8f097" (UID: "ea73b814-b74d-4992-b613-08d04dd8f097"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:42.652651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.652567    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls" pod "ea73b814-b74d-4992-b613-08d04dd8f097" (UID: "ea73b814-b74d-4992-b613-08d04dd8f097"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:42.652812 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.652795    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj" pod "ea73b814-b74d-4992-b613-08d04dd8f097" (UID: "ea73b814-b74d-4992-b613-08d04dd8f097"). InnerVolumeSpecName "kube-api-access-kcfjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:42.752258 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.752224    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:42.752258 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.752257    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea73b814-b74d-4992-b613-08d04dd8f097-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:42.752467 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.752268    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcfjj\" (UniqueName: \"kubernetes.io/projected/ea73b814-b74d-4992-b613-08d04dd8f097-kube-api-access-kcfjj\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:42.752467 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.752279    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea73b814-b74d-4992-b613-08d04dd8f097-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:25:42.809801 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.809763    5579 generic.go:356] "Generic (PLEG): container finished" podID="ea73b814-b74d-4992-b613-08d04dd8f097" containerID="ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3" exitCode=0
Oct 30 22:25:42.810024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.809811    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"
Oct 30 22:25:42.810024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.809850    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" event={"ID":"ea73b814-b74d-4992-b613-08d04dd8f097","Type":"ContainerDied","Data":"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"}
Oct 30 22:25:42.810024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.809947    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc" event={"ID":"ea73b814-b74d-4992-b613-08d04dd8f097","Type":"ContainerDied","Data":"791e57b53841fbfddc18bebfd4b8a369877d931b2b72b714103c455160c104c4"}
Oct 30 22:25:42.810024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.809981    5579 scope.go:122] "RemoveContainer" containerID="ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"
Oct 30 22:25:42.820377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.820358    5579 scope.go:122] "RemoveContainer" containerID="ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"
Oct 30 22:25:42.820650 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:25:42.820630    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3\": container with ID starting with ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3 not found: ID does not exist" containerID="ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"
Oct 30 22:25:42.820712 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.820659    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3"} err="failed to get container status \"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3\": rpc error: code = NotFound desc = could not find container \"ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3\": container with ID starting with ed68f63ddd709d857e992a50d48a9123aff16e9a10a49302903d45e2ab9b98b3 not found: ID does not exist"
Oct 30 22:25:42.929698 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:25:42.929660    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:25:42.966534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.966505    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 22:25:42.972944 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:42.972897    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-17d809-d4787f486-sfsnc"]
Oct 30 22:25:43.149608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:25:43.149570    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea73b814-b74d-4992-b613-08d04dd8f097" path="/var/lib/kubelet/pods/ea73b814-b74d-4992-b613-08d04dd8f097/volumes"
Oct 30 22:26:12.929798 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:26:12.929763    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:26:42.930140 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:26:42.930103    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:26:55.536425 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.536344    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:26:55.536982 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.536538    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerName="discovery" containerID="cri-o://7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168" gracePeriod=30
Oct 30 22:26:55.799605 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.799530    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:26:55.913225 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913183    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913233    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913342    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913374    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913426 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913409    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913443    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.913648 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.913486    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\") pod \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\" (UID: \"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a\") "
Oct 30 22:26:55.915184 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.915041    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:55.917090 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.917064    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:55.922970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.919191    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "kube-api-access-h44tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:55.922970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.919446    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:55.922970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.922063    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:55.923224 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.923050    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:55.923902 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:55.923867    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig" pod "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" (UID: "d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:56.015376 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015341    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h44tl\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-kube-api-access-h44tl\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015376 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015373    5579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-cacerts\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015376 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015385    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015393    5579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-kubeconfig\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015402    5579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-ca-configmap\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015411    5579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-local-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.015616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.015419    5579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a-istio-csr-dns-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:26:56.209189 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.209155    5579 generic.go:356] "Generic (PLEG): container finished" podID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerID="7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168" exitCode=0
Oct 30 22:26:56.209394 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.209201    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"
Oct 30 22:26:56.209394 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.209240    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" event={"ID":"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a","Type":"ContainerDied","Data":"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"}
Oct 30 22:26:56.209394 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.209297    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6" event={"ID":"d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a","Type":"ContainerDied","Data":"a9d1933023e5bed4ef919c6f9189c1370cae0f617f23bf5966e8017a0f05fdd8"}
Oct 30 22:26:56.209394 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.209327    5579 scope.go:122] "RemoveContainer" containerID="7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"
Oct 30 22:26:56.220221 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.220132    5579 scope.go:122] "RemoveContainer" containerID="7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"
Oct 30 22:26:56.220491 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:26:56.220440    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168\": container with ID starting with 7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168 not found: ID does not exist" containerID="7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"
Oct 30 22:26:56.220491 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.220474    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168"} err="failed to get container status \"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168\": rpc error: code = NotFound desc = could not find container \"7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168\": container with ID starting with 7400b266f5275f8f76a26f7b7f6d3195ae1dec8a847d75c87b0254105cf80168 not found: ID does not exist"
Oct 30 22:26:56.363958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.363896    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:26:56.410008 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:56.409970    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s95n6"]
Oct 30 22:26:57.146924 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:26:57.146889    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" path="/var/lib/kubelet/pods/d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a/volumes"
Oct 30 22:27:00.559410 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:00.559383    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:27:00.559829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:00.559609    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy" containerID="cri-o://c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b" gracePeriod=30
Oct 30 22:27:05.817385 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.817355    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:27:05.912824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912792    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912852    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912881    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912905    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912924    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.912987    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913019    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913119    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913151    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\") pod \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\" (UID: \"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b\") "
Oct 30 22:27:05.913439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913306    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:05.913439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913323    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:05.913629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913534    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:05.913629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913542    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:05.913629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913580    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:05.913793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913636    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:05.913793 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.913717    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:05.915218 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.915191    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:05.915338 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.915310    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "kube-api-access-zsznk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:05.915618 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.915590    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:05.915701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:05.915589    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo" pod "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" (UID: "1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:27:06.014502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014469    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014498    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014502 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014508    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014517    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsznk\" (UniqueName: \"kubernetes.io/projected/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-kube-api-access-zsznk\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014528    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014537    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.014775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.014549    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:27:06.267019 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.266906    5579 generic.go:356] "Generic (PLEG): container finished" podID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerID="c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b" exitCode=0
Oct 30 22:27:06.267019 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.266971    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"
Oct 30 22:27:06.267019 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.267003    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" event={"ID":"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b","Type":"ContainerDied","Data":"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"}
Oct 30 22:27:06.267272 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.267067    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq" event={"ID":"1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b","Type":"ContainerDied","Data":"cddd6a56b3bebb47032120b69537b486cef142fa15ed3c664bd31a84eba796dc"}
Oct 30 22:27:06.267272 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.267092    5579 scope.go:122] "RemoveContainer" containerID="c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"
Oct 30 22:27:06.277497 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.277473    5579 scope.go:122] "RemoveContainer" containerID="c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"
Oct 30 22:27:06.277830 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:27:06.277807    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b\": container with ID starting with c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b not found: ID does not exist" containerID="c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"
Oct 30 22:27:06.277883 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.277843    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b"} err="failed to get container status \"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b\": rpc error: code = NotFound desc = could not find container \"c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b\": container with ID starting with c23e26c47663ff1e1e03d455c47397a8f49f731f856ffc8a83cb680d451e139b not found: ID does not exist"
Oct 30 22:27:06.429134 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.429086    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:27:06.462485 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:06.462445    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c1e2ab-openshift-default-bcd8478cf-jw9rq"]
Oct 30 22:27:07.145306 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:27:07.145276    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" path="/var/lib/kubelet/pods/1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b/volumes"
Oct 30 22:27:12.928792 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:27:12.928752    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:27:42.929830 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:27:42.929794    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:28:12.928260 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:28:12.928222    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:28:42.929525 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:28:42.929449    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:29:12.929661 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:29:12.929622    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:29:42.932082 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:29:42.932043    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:29:44.314482 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.314441    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:29:44.314960 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.314684    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" podUID="ad813560-0470-4e57-be06-61336ac24fa8" containerName="maas-api" containerID="cri-o://0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a" gracePeriod=30
Oct 30 22:29:44.577999 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.577917    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:29:44.688498 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.688468    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\") pod \"ad813560-0470-4e57-be06-61336ac24fa8\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") "
Oct 30 22:29:44.688839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.688551    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\") pod \"ad813560-0470-4e57-be06-61336ac24fa8\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") "
Oct 30 22:29:44.688839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.688656    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\" (UniqueName: \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\") pod \"ad813560-0470-4e57-be06-61336ac24fa8\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") "
Oct 30 22:29:44.688839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.688706    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") pod \"ad813560-0470-4e57-be06-61336ac24fa8\" (UID: \"ad813560-0470-4e57-be06-61336ac24fa8\") "
Oct 30 22:29:44.689059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.688898    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca" pod "ad813560-0470-4e57-be06-61336ac24fa8" (UID: "ad813560-0470-4e57-be06-61336ac24fa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:44.689168 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.689146    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813560-0470-4e57-be06-61336ac24fa8-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.691205 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.691159    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs" pod "ad813560-0470-4e57-be06-61336ac24fa8" (UID: "ad813560-0470-4e57-be06-61336ac24fa8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:44.691344 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.691201    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls" pod "ad813560-0470-4e57-be06-61336ac24fa8" (UID: "ad813560-0470-4e57-be06-61336ac24fa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:44.691521 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.691496    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7" pod "ad813560-0470-4e57-be06-61336ac24fa8" (UID: "ad813560-0470-4e57-be06-61336ac24fa8"). InnerVolumeSpecName "kube-api-access-djdf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:44.789896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.789858    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.789896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.789893    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djdf7\" (UniqueName: \"kubernetes.io/projected/ad813560-0470-4e57-be06-61336ac24fa8-kube-api-access-djdf7\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.789896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:44.789906    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813560-0470-4e57-be06-61336ac24fa8-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:29:45.136702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.136664    5579 generic.go:356] "Generic (PLEG): container finished" podID="ad813560-0470-4e57-be06-61336ac24fa8" containerID="0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a" exitCode=0
Oct 30 22:29:45.136958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.136708    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"
Oct 30 22:29:45.136958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.136723    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" event={"ID":"ad813560-0470-4e57-be06-61336ac24fa8","Type":"ContainerDied","Data":"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"}
Oct 30 22:29:45.136958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.136774    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf" event={"ID":"ad813560-0470-4e57-be06-61336ac24fa8","Type":"ContainerDied","Data":"05d9a2781f2ccf5ccc011406118d35d1d0a99a1db57974b0961b9f39e02da3fc"}
Oct 30 22:29:45.136958 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.136804    5579 scope.go:122] "RemoveContainer" containerID="0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"
Oct 30 22:29:45.148020 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.147997    5579 scope.go:122] "RemoveContainer" containerID="0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"
Oct 30 22:29:45.148297 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:29:45.148278    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a\": container with ID starting with 0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a not found: ID does not exist" containerID="0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"
Oct 30 22:29:45.148358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.148309    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a"} err="failed to get container status \"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a\": rpc error: code = NotFound desc = could not find container \"0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a\": container with ID starting with 0298c027d15900713cdab474bf1bb8a19a278c19cf01bfb3efc7ea1c1502f78a not found: ID does not exist"
Oct 30 22:29:45.290890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.290799    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:29:45.294661 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:45.294621    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3aa85e-54b7765467-l4psf"]
Oct 30 22:29:47.145009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:29:47.144978    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad813560-0470-4e57-be06-61336ac24fa8" path="/var/lib/kubelet/pods/ad813560-0470-4e57-be06-61336ac24fa8/volumes"
Oct 30 22:30:12.930326 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:30:12.930239    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:30:20.143827 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:20.143781    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:30:20.144796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:20.144016    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" containerID="cri-o://fa079b25747c388395b54f3249d8c87d00e97ac5923d2c70980970c9fe271c0d" gracePeriod=30
Oct 30 22:30:20.189383 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:20.189348    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:30:20.189596 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:20.189556    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" containerID="cri-o://74dd6f50d0898ba226430a81efd7527b1cc05d24139a065d3c76a0b50a5416e4" gracePeriod=30
Oct 30 22:30:24.949364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:24.949323    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-d5zq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:30:24.949824 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:24.949389    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:30:25.135776 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.135736    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-c8m6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:30:25.135983 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.135837    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:30:25.365326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.364219    5579 generic.go:356] "Generic (PLEG): container finished" podID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerID="fa079b25747c388395b54f3249d8c87d00e97ac5923d2c70980970c9fe271c0d" exitCode=0
Oct 30 22:30:25.365326 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.364452    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" event={"ID":"35ecfd70-c6c4-4bba-b695-d013bccf375e","Type":"ContainerDied","Data":"fa079b25747c388395b54f3249d8c87d00e97ac5923d2c70980970c9fe271c0d"}
Oct 30 22:30:25.366781 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.366654    5579 generic.go:356] "Generic (PLEG): container finished" podID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerID="74dd6f50d0898ba226430a81efd7527b1cc05d24139a065d3c76a0b50a5416e4" exitCode=0
Oct 30 22:30:25.366781 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.366725    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" event={"ID":"2d4653cd-d8e5-49dd-9706-b1152bbdb89f","Type":"ContainerDied","Data":"74dd6f50d0898ba226430a81efd7527b1cc05d24139a065d3c76a0b50a5416e4"}
Oct 30 22:30:25.441255 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.441229    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:30:25.467831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.467807    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:30:25.593970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.593851    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.593970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.593898    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.593970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.593937    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.593970 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.593972    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594099    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594155    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594183    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594218    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594262    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594269    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594309    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594339 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594332    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594352    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594402    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594443    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594479    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594512    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594529    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594567    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594600    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\") pod \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\" (UID: \"2d4653cd-d8e5-49dd-9706-b1152bbdb89f\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594625    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594670    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\") pod \"35ecfd70-c6c4-4bba-b695-d013bccf375e\" (UID: \"35ecfd70-c6c4-4bba-b695-d013bccf375e\") "
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594653    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594718    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.594768 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594724    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.594858    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595066    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595089    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595104    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595120    5579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-data\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595133    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595150    5579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-credential-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595164    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595179    5579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-workload-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.595479 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595233    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.596035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.595905    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:25.596654 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.596619    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "kube-api-access-2sfwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:25.596774 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.596705    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.597150 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.597131    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:25.597415 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.597202    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "kube-api-access-zkhz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:25.597415 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.597401    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:30:25.597570 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.597469    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:25.598097 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.598078    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy" pod "2d4653cd-d8e5-49dd-9706-b1152bbdb89f" (UID: "2d4653cd-d8e5-49dd-9706-b1152bbdb89f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:25.598173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.598154    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo" pod "35ecfd70-c6c4-4bba-b695-d013bccf375e" (UID: "35ecfd70-c6c4-4bba-b695-d013bccf375e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:30:25.696458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696421    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696451    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkhz8\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-kube-api-access-zkhz8\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696458 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696463    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696472    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696480    5579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-workload-socket\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696489    5579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-token\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696497    5579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ecfd70-c6c4-4bba-b695-d013bccf375e-istiod-ca-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696505    5579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-istio-podinfo\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696513    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sfwd\" (UniqueName: \"kubernetes.io/projected/2d4653cd-d8e5-49dd-9706-b1152bbdb89f-kube-api-access-2sfwd\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:25.696697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:25.696521    5579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ecfd70-c6c4-4bba-b695-d013bccf375e-istio-envoy\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:26.375010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.374978    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"
Oct 30 22:30:26.375010 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.374986    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p" event={"ID":"2d4653cd-d8e5-49dd-9706-b1152bbdb89f","Type":"ContainerDied","Data":"2b38ac88b3d7bfe0c7823467863fb35de0baa928eef4cae22474ee16e6b26487"}
Oct 30 22:30:26.375607 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.375065    5579 scope.go:122] "RemoveContainer" containerID="74dd6f50d0898ba226430a81efd7527b1cc05d24139a065d3c76a0b50a5416e4"
Oct 30 22:30:26.376919 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.376895    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"
Oct 30 22:30:26.377036 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.377012    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7" event={"ID":"35ecfd70-c6c4-4bba-b695-d013bccf375e","Type":"ContainerDied","Data":"20a9fd7e25a26c8d057e178549cdbf61ca0adb9818efd55871fc54f2ad736149"}
Oct 30 22:30:26.388125 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.388104    5579 scope.go:122] "RemoveContainer" containerID="fa079b25747c388395b54f3249d8c87d00e97ac5923d2c70980970c9fe271c0d"
Oct 30 22:30:26.574871 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.574784    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:30:26.578120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.578096    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-d5zq7"]
Oct 30 22:30:26.682744 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.682710    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:30:26.691664 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:26.691634    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8m6p"]
Oct 30 22:30:27.146646 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:27.146614    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" path="/var/lib/kubelet/pods/2d4653cd-d8e5-49dd-9706-b1152bbdb89f/volumes"
Oct 30 22:30:27.147069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:27.147055    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" path="/var/lib/kubelet/pods/35ecfd70-c6c4-4bba-b695-d013bccf375e/volumes"
Oct 30 22:30:42.929183 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:30:42.929144    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:30:45.778477 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:45.778439    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:30:45.778896 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:45.778641    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" podUID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" containerName="maas-api" containerID="cri-o://f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b" gracePeriod=30
Oct 30 22:30:46.050464 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.050433    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:30:46.088131 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.088097    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\") pod \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") "
Oct 30 22:30:46.088300 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.088167    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\" (UniqueName: \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\") pod \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") "
Oct 30 22:30:46.088300 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.088258    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\") pod \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") "
Oct 30 22:30:46.088460 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.088440    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca" pod "4c19bb0a-1fcd-44b3-8619-c09b8203bff4" (UID: "4c19bb0a-1fcd-44b3-8619-c09b8203bff4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:46.088532 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.088518    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:46.090280 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.090259    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs" pod "4c19bb0a-1fcd-44b3-8619-c09b8203bff4" (UID: "4c19bb0a-1fcd-44b3-8619-c09b8203bff4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:46.090337 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.090298    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2" pod "4c19bb0a-1fcd-44b3-8619-c09b8203bff4" (UID: "4c19bb0a-1fcd-44b3-8619-c09b8203bff4"). InnerVolumeSpecName "kube-api-access-6h9n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:46.188832 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.188801    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") pod \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\" (UID: \"4c19bb0a-1fcd-44b3-8619-c09b8203bff4\") "
Oct 30 22:30:46.189053 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.189037    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h9n2\" (UniqueName: \"kubernetes.io/projected/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-kube-api-access-6h9n2\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:46.189113 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.189060    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:46.191055 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.191024    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls" pod "4c19bb0a-1fcd-44b3-8619-c09b8203bff4" (UID: "4c19bb0a-1fcd-44b3-8619-c09b8203bff4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:46.289480 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.289399    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c19bb0a-1fcd-44b3-8619-c09b8203bff4-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:30:46.496916 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.496860    5579 generic.go:356] "Generic (PLEG): container finished" podID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" containerID="f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b" exitCode=0
Oct 30 22:30:46.497136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.496976    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" event={"ID":"4c19bb0a-1fcd-44b3-8619-c09b8203bff4","Type":"ContainerDied","Data":"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"}
Oct 30 22:30:46.497136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.497062    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x" event={"ID":"4c19bb0a-1fcd-44b3-8619-c09b8203bff4","Type":"ContainerDied","Data":"dc80501c8ab25c24c9b7c0c7392e8aa3bdd1d41c2c96baae1612508de77eeafc"}
Oct 30 22:30:46.497136 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.497115    5579 scope.go:122] "RemoveContainer" containerID="f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"
Oct 30 22:30:46.497333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.497313    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"
Oct 30 22:30:46.513513 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.513490    5579 scope.go:122] "RemoveContainer" containerID="f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"
Oct 30 22:30:46.513823 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:30:46.513807    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b\": container with ID starting with f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b not found: ID does not exist" containerID="f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"
Oct 30 22:30:46.513887 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.513834    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b"} err="failed to get container status \"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b\": rpc error: code = NotFound desc = could not find container \"f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b\": container with ID starting with f2243410fb6c633ec5c8d00eb16d7a48f1d19fa6c7e90d9d2fe13a5e508b208b not found: ID does not exist"
Oct 30 22:30:46.650187 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.650152    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:30:46.653839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:46.653810    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-4d8041-58d89fdff4-7q65x"]
Oct 30 22:30:47.145744 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:30:47.145704    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" path="/var/lib/kubelet/pods/4c19bb0a-1fcd-44b3-8619-c09b8203bff4/volumes"
Oct 30 22:31:12.931914 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:31:12.931868    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:31:42.932783 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:31:42.932699    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:31:57.620370 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.620333    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 22:31:57.620877 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.620548    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" podUID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" containerName="maas-api" containerID="cri-o://a4e30059912ba4a6aa0c43c0ce5fd8cd8abde08b83da532c581b3efaab704da9" gracePeriod=30
Oct 30 22:31:57.877694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.877618    5579 generic.go:356] "Generic (PLEG): container finished" podID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" containerID="a4e30059912ba4a6aa0c43c0ce5fd8cd8abde08b83da532c581b3efaab704da9" exitCode=0
Oct 30 22:31:57.877829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.877689    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" event={"ID":"22c18022-1ea1-40c1-9a89-57f3b9e1f959","Type":"ContainerDied","Data":"a4e30059912ba4a6aa0c43c0ce5fd8cd8abde08b83da532c581b3efaab704da9"}
Oct 30 22:31:57.877829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.877740    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj" event={"ID":"22c18022-1ea1-40c1-9a89-57f3b9e1f959","Type":"ContainerDied","Data":"7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9"}
Oct 30 22:31:57.877829 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.877756    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eef4dda4148e85731ea99d00694a4dd1ea20a6dc0f3211f81a8083b0aa38dd9"
Oct 30 22:31:57.882483 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.882462    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 22:31:57.955830 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.955795    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\") pod \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") "
Oct 30 22:31:57.956037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.955856    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\" (UniqueName: \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\") pod \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") "
Oct 30 22:31:57.956037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.955882    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\") pod \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") "
Oct 30 22:31:57.956037 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.955968    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") pod \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\" (UID: \"22c18022-1ea1-40c1-9a89-57f3b9e1f959\") "
Oct 30 22:31:57.956283 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.956259    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca" pod "22c18022-1ea1-40c1-9a89-57f3b9e1f959" (UID: "22c18022-1ea1-40c1-9a89-57f3b9e1f959"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:57.957886 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.957863    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs" pod "22c18022-1ea1-40c1-9a89-57f3b9e1f959" (UID: "22c18022-1ea1-40c1-9a89-57f3b9e1f959"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:57.958450 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.958429    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls" pod "22c18022-1ea1-40c1-9a89-57f3b9e1f959" (UID: "22c18022-1ea1-40c1-9a89-57f3b9e1f959"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:57.958506 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:57.958436    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl" pod "22c18022-1ea1-40c1-9a89-57f3b9e1f959" (UID: "22c18022-1ea1-40c1-9a89-57f3b9e1f959"). InnerVolumeSpecName "kube-api-access-mskjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:58.056655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:58.056618    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22c18022-1ea1-40c1-9a89-57f3b9e1f959-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.056655 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:58.056654    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mskjl\" (UniqueName: \"kubernetes.io/projected/22c18022-1ea1-40c1-9a89-57f3b9e1f959-kube-api-access-mskjl\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.056879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:58.056668    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.056879 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:58.056682    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22c18022-1ea1-40c1-9a89-57f3b9e1f959-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.882498 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:58.882467    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"
Oct 30 22:31:59.037075 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:59.037037    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 22:31:59.083895 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:59.083861    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5402dd-765fb58b47-mpjdj"]
Oct 30 22:31:59.145851 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:31:59.145817    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" path="/var/lib/kubelet/pods/22c18022-1ea1-40c1-9a89-57f3b9e1f959/volumes"
Oct 30 22:32:12.288993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.288948    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 22:32:12.289451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.289164    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" podUID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" containerName="manager" containerID="cri-o://45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798" gracePeriod=30
Oct 30 22:32:12.547320 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.547245    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 22:32:12.695612 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.695573    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\") pod \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") "
Oct 30 22:32:12.695789 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.695707    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\") pod \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") "
Oct 30 22:32:12.695869 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.695786    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\" (UniqueName: \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\") pod \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\" (UID: \"899dbfe4-20fe-43c2-ad18-538ab2d213e2\") "
Oct 30 22:32:12.697922 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.697890    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs" pod "899dbfe4-20fe-43c2-ad18-538ab2d213e2" (UID: "899dbfe4-20fe-43c2-ad18-538ab2d213e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:12.698077 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.697970    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert" pod "899dbfe4-20fe-43c2-ad18-538ab2d213e2" (UID: "899dbfe4-20fe-43c2-ad18-538ab2d213e2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:12.698238 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.698219    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5" pod "899dbfe4-20fe-43c2-ad18-538ab2d213e2" (UID: "899dbfe4-20fe-43c2-ad18-538ab2d213e2"). InnerVolumeSpecName "kube-api-access-f5sb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:12.797240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.797199    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.797240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.797233    5579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/899dbfe4-20fe-43c2-ad18-538ab2d213e2-webhook-cert\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.797240 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.797243    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5sb5\" (UniqueName: \"kubernetes.io/projected/899dbfe4-20fe-43c2-ad18-538ab2d213e2-kube-api-access-f5sb5\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.929534 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:32:12.929498    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:32:12.959358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.959325    5579 generic.go:356] "Generic (PLEG): container finished" podID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" containerID="45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798" exitCode=0
Oct 30 22:32:12.959548 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.959387    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5844bc79b5-5rxcg"
Oct 30 22:32:12.959548 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.959403    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" event={"ID":"899dbfe4-20fe-43c2-ad18-538ab2d213e2","Type":"ContainerDied","Data":"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"}
Oct 30 22:32:12.959548 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.959458    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5844bc79b5-5rxcg" event={"ID":"899dbfe4-20fe-43c2-ad18-538ab2d213e2","Type":"ContainerDied","Data":"efd4ae7720a646bccc680a1d6fed7d4e274ea2665e7057b1c282cd64f0c82f5b"}
Oct 30 22:32:12.959548 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.959486    5579 scope.go:122] "RemoveContainer" containerID="45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"
Oct 30 22:32:12.970606 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.970589    5579 scope.go:122] "RemoveContainer" containerID="45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"
Oct 30 22:32:12.970848 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:32:12.970832    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798\": container with ID starting with 45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798 not found: ID does not exist" containerID="45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"
Oct 30 22:32:12.970899 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:12.970859    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798"} err="failed to get container status \"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798\": rpc error: code = NotFound desc = could not find container \"45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798\": container with ID starting with 45a2f70c13435d171221b914d961b06e4fea8cd3905f47a3da2db4e3ce554798 not found: ID does not exist"
Oct 30 22:32:13.120002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:13.119959    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 22:32:13.166697 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:13.166388    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5844bc79b5-5rxcg"]
Oct 30 22:32:15.147309 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:15.147265    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" path="/var/lib/kubelet/pods/899dbfe4-20fe-43c2-ad18-538ab2d213e2/volumes"
Oct 30 22:32:17.715699 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:17.715665    5579 scope.go:122] "RemoveContainer" containerID="a4e30059912ba4a6aa0c43c0ce5fd8cd8abde08b83da532c581b3efaab704da9"
Oct 30 22:32:36.180379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180344    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"]
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180723    5579 cpu_manager.go:414] "containerMap: removing container" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerName="discovery"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180734    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerName="discovery"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180753    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ea73b814-b74d-4992-b613-08d04dd8f097" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180762    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea73b814-b74d-4992-b613-08d04dd8f097" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180769    5579 cpu_manager.go:414] "containerMap: removing container" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180774    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180781    5579 cpu_manager.go:414] "containerMap: removing container" podUID="fb242fc4-737b-42aa-b1da-de7734c10151" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180786    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb242fc4-737b-42aa-b1da-de7734c10151" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180792    5579 cpu_manager.go:414] "containerMap: removing container" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180796    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180805    5579 cpu_manager.go:414] "containerMap: removing container" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180809    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180818    5579 cpu_manager.go:414] "containerMap: removing container" podUID="c82ce272-d654-4505-b3e3-b912bdf3d10b" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180823    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c82ce272-d654-4505-b3e3-b912bdf3d10b" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180832    5579 cpu_manager.go:414] "containerMap: removing container" podUID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" containerName="manager"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180840    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" containerName="manager"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180847    5579 cpu_manager.go:414] "containerMap: removing container" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180852    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180859    5579 cpu_manager.go:414] "containerMap: removing container" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180864    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180873    5579 cpu_manager.go:414] "containerMap: removing container" podUID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180879    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180895    5579 cpu_manager.go:414] "containerMap: removing container" podUID="ad813560-0470-4e57-be06-61336ac24fa8" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180901    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad813560-0470-4e57-be06-61336ac24fa8" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180912    5579 cpu_manager.go:414] "containerMap: removing container" podUID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180920    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180949    5579 cpu_manager.go:414] "containerMap: removing container" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180956    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180970    5579 cpu_manager.go:414] "containerMap: removing container" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180980    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180992    5579 cpu_manager.go:414] "containerMap: removing container" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.180999    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181013    5579 cpu_manager.go:414] "containerMap: removing container" podUID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181020    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181034    5579 cpu_manager.go:414] "containerMap: removing container" podUID="cbf97f98-274f-4242-beee-e462faa43e7a" containerName="maas-api"
Oct 30 22:32:36.181074 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181040    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbf97f98-274f-4242-beee-e462faa43e7a" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181147    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="899dbfe4-20fe-43c2-ad18-538ab2d213e2" containerName="manager"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181159    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc45c9a2-f318-4783-bafc-0ddebb0c6d2b" containerName="main"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181167    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb2a2111-4f1f-43bc-a5e4-931b2b921c71" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181175    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="6052ef14-3607-43d5-977a-5689d42faebe" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181182    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c19bb0a-1fcd-44b3-8619-c09b8203bff4" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181191    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbf97f98-274f-4242-beee-e462faa43e7a" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181202    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3d33aa2-80f8-4cc0-899c-baf14c5d6f6a" containerName="discovery"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181211    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad813560-0470-4e57-be06-61336ac24fa8" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181220    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="22c18022-1ea1-40c1-9a89-57f3b9e1f959" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181229    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea73b814-b74d-4992-b613-08d04dd8f097" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181237    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a1f58c7-c792-45b0-b9e8-81725268dd74" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181245    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb242fc4-737b-42aa-b1da-de7734c10151" containerName="maas-api"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181252    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4653cd-d8e5-49dd-9706-b1152bbdb89f" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181260    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ec12dda-9fe5-4bfa-9d7b-f818099bbf7b" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181267    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="35ecfd70-c6c4-4bba-b695-d013bccf375e" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181276    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="845c9a0b-5670-46a0-b2bc-2e8504615dbd" containerName="istio-proxy"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181283    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="887e1fb1-5161-4ab2-a26c-0ec95b3dd229" containerName="main"
Oct 30 22:32:36.183160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.181293    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="c82ce272-d654-4505-b3e3-b912bdf3d10b" containerName="maas-api"
Oct 30 22:32:36.186726 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.186701    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208395 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208364    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208530 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208412    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e480602c-5242-405c-9fcb-7e7f0525f402-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208576 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208531    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208620 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208579    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8t6j\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-kube-api-access-n8t6j\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208674 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208654    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e480602c-5242-405c-9fcb-7e7f0525f402-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208721 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208688    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208800 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208783    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208827    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.208916 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.208895    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309393    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309434    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309454    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309484    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309513    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e480602c-5242-405c-9fcb-7e7f0525f402-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309544    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309581    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8t6j\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-kube-api-access-n8t6j\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309606    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e480602c-5242-405c-9fcb-7e7f0525f402-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.309685 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309634    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.310066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309863    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.310066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.309945    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.310066 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.310041    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.310236 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.310216    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.310291 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.310253    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e480602c-5242-405c-9fcb-7e7f0525f402-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.312059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.312036    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e480602c-5242-405c-9fcb-7e7f0525f402-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.312258 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.312239    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e480602c-5242-405c-9fcb-7e7f0525f402-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.363361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.363329    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.363530 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.363425    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8t6j\" (UniqueName: \"kubernetes.io/projected/e480602c-5242-405c-9fcb-7e7f0525f402-kube-api-access-n8t6j\") pod \"maas-default-gateway-openshift-default-694db55c87-z89qz\" (UID: \"e480602c-5242-405c-9fcb-7e7f0525f402\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.398427 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.398391    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"]
Oct 30 22:32:36.499622 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.499542    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:36.922321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.922285    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"]
Oct 30 22:32:36.928505 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:32:36.928477    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode480602c_5242_405c_9fcb_7e7f0525f402.slice/crio-d68f249c45847eab47fc10b00e5c94fbac14fd2a960d7f5dfa861e3b9986e129 WatchSource:0}: Error finding container d68f249c45847eab47fc10b00e5c94fbac14fd2a960d7f5dfa861e3b9986e129: Status 404 returned error can't find the container with id d68f249c45847eab47fc10b00e5c94fbac14fd2a960d7f5dfa861e3b9986e129
Oct 30 22:32:36.930586 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.930556    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:32:36.930671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.930618    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:32:36.930671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:36.930646    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:32:37.085399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.085365    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" event={"ID":"e480602c-5242-405c-9fcb-7e7f0525f402","Type":"ContainerStarted","Data":"3d1706ec41821e26cb5a80dd7ccfae4ebbe885233fda81214d0589074df31a7d"}
Oct 30 22:32:37.085618 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.085424    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" event={"ID":"e480602c-5242-405c-9fcb-7e7f0525f402","Type":"ContainerStarted","Data":"d68f249c45847eab47fc10b00e5c94fbac14fd2a960d7f5dfa861e3b9986e129"}
Oct 30 22:32:37.199892 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.199770    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podStartSLOduration=1.199748681 podStartE2EDuration="1.199748681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:37.196501261 +0000 UTC m=+2962.166347671" watchObservedRunningTime="2026-10-30 22:32:37.199748681 +0000 UTC m=+2962.169595090"
Oct 30 22:32:37.500222 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.500138    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:37.501653 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.501629    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:37.501777 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:37.501677    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:38.500269 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:38.500229    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:38.500704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:38.500305    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:39.500631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:39.500586    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:39.501062 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:39.500657    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:40.500137 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:40.500100    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:40.500318 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:40.500153    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:41.500720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:41.500679    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:41.501148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:41.500738    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:42.500533 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:42.500500    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:42.500818 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:42.500580    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:42.930070 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:32:42.930033    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:32:43.500283 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:43.500241    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 22:32:43.500522 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:43.500309    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 22:32:45.193514 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:45.193484    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:45.194041 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:45.193865    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:32:45.194729 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:32:45.194703    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz"
Oct 30 22:33:12.930589 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:33:12.930511    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:33:42.932066 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:33:42.932027    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:34:06.845214 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.845179    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"]
Oct 30 22:34:06.848941 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.848906    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891083 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891047    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891094    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891119    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891224    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891263    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891285    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891353    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw5vd\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-kube-api-access-fw5vd\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891379    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.891423 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.891411    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.957030 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.956991    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"]
Oct 30 22:34:06.992629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992590    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.992831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992637    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.992831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992675    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.992831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992707    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.992831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992738    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.992831 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992769    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5vd\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-kube-api-access-fw5vd\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992899    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.992984    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993186 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993060    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993355 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993221    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993355 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993305    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993517 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993494    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993648    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.993808 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.993693    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.995468 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.995449    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:06.995694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:06.995673    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:07.046150 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.046120    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:07.046315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.046159    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5vd\" (UniqueName: \"kubernetes.io/projected/92896565-25f6-44a4-9abb-2ebaedb4b6d4-kube-api-access-fw5vd\") pod \"maas-default-gateway-openshift-default-694db55c87-5mdln\" (UID: \"92896565-25f6-44a4-9abb-2ebaedb4b6d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:07.161721 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.161694    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:07.583868 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.583770    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"]
Oct 30 22:34:07.590055 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:34:07.590026    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92896565_25f6_44a4_9abb_2ebaedb4b6d4.slice/crio-c59aae8724d9c51bdd7f1520b676c8a55894946b6279727e3a778650f076eb44 WatchSource:0}: Error finding container c59aae8724d9c51bdd7f1520b676c8a55894946b6279727e3a778650f076eb44: Status 404 returned error can't find the container with id c59aae8724d9c51bdd7f1520b676c8a55894946b6279727e3a778650f076eb44
Oct 30 22:34:07.592156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.592127    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:34:07.592230 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.592198    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:34:07.592268 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:07.592227    5579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 22:34:08.556177 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:08.556141    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" event={"ID":"92896565-25f6-44a4-9abb-2ebaedb4b6d4","Type":"ContainerStarted","Data":"720e860398dceca64e3b5db22c3577b35e39aebcf8dac97af6e67b29f9a431cd"}
Oct 30 22:34:08.556694 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:08.556198    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" event={"ID":"92896565-25f6-44a4-9abb-2ebaedb4b6d4","Type":"ContainerStarted","Data":"c59aae8724d9c51bdd7f1520b676c8a55894946b6279727e3a778650f076eb44"}
Oct 30 22:34:08.712603 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:08.712545    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podStartSLOduration=2.712529394 podStartE2EDuration="2.712529394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:08.711416217 +0000 UTC m=+3053.681262623" watchObservedRunningTime="2026-10-30 22:34:08.712529394 +0000 UTC m=+3053.682375802"
Oct 30 22:34:09.162604 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:09.162571    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:09.164193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:09.164164    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:09.164322 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:09.164218    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:10.162981 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:10.162945    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:10.163394 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:10.163001    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:11.162276 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:11.162240    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:11.162504 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:11.162303    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:12.162565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:12.162525    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:12.163020 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:12.162582    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:12.967336 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:34:12.967290    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:34:13.162471 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:13.162435    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:13.162651 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:13.162507    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:14.162364 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:14.162323    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:14.162776 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:14.162741    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:15.163356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:15.162794    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:34:15.163356 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:15.162851    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": dial tcp 10.134.0.120:15021: connect: connection refused"
Oct 30 22:34:17.162875 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:17.162842    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:34:17.163417 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:17.162897    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:34:18.204156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:18.204114    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:34:18.204588 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:18.204189    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:34:19.246148 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:19.246102    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:34:19.246701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:19.246175    5579 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:34:20.224843 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:20.224805    5579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:20.225381 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:20.225360    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:20.226185 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:34:20.226167    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln"
Oct 30 22:34:42.929734 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:34:42.929657    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:35:12.929436 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:35:12.929391    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:35:42.928445 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:35:42.928401    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:36:12.928619 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:36:12.928538    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:36:42.928481 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:36:42.928446    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:37:12.928727 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:37:12.928684    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:37:42.929882 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:37:42.929798    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:38:12.929947 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:38:12.929885    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:38:42.929034 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:38:42.928994    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:39:12.929016 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:39:12.928915    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:39:42.929654 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:39:42.929614    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:39:46.240412 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:39:46.240051    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-z89qz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:39:46.240412 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:39:46.240112    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-z89qz" podUID="e480602c-5242-405c-9fcb-7e7f0525f402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:40:12.928662 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:40:12.928626    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:40:42.929466 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:40:42.929390    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:41:12.928638 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:41:12.928599    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:41:42.929560 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:41:42.929522    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:42:12.928510 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:42:12.928473    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:42:42.928012 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:42:42.927972    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:43:12.930822 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:43:12.930708    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:43:42.929056 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:43:42.929012    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:44:12.928550 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:44:12.928509    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:44:42.934285 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:44:42.934245    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:45:13.004297 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:45:13.004194    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:45:42.930318 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:45:42.930278    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:46:12.929706 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:46:12.929673    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:46:42.929971 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:46:42.929871    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:47:12.929297 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:47:12.929251    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:47:43.005953 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:47:43.005097    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:48:12.928842 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:48:12.928805    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:48:42.930190 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:48:42.930146    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:49:12.928630 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:49:12.928591    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:49:36.280009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:49:36.279062    5579 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mdln container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:49:36.280009 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:49:36.279168    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mdln" podUID="92896565-25f6-44a4-9abb-2ebaedb4b6d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:49:42.928200 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:49:42.928162    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:50:11.542363 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:11.542325    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 22:50:11.542839 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:11.542559    5579 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerName="maas-api" containerID="cri-o://3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e" gracePeriod=30
Oct 30 22:50:12.385755 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.385714    5579 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.48:8443/health\": dial tcp 10.134.0.48:8443: connect: connection refused"
Oct 30 22:50:12.794252 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.794225    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 22:50:12.856349 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.856320    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\") pod \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") "
Oct 30 22:50:12.856545 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.856366    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\") pod \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") "
Oct 30 22:50:12.856545 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.856429    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\" (UniqueName: \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\") pod \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") "
Oct 30 22:50:12.856545 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.856519    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\") pod \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\" (UID: \"5bc2cbca-07e7-4857-b075-31eaba6eabc5\") "
Oct 30 22:50:12.856852 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.856814    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca" pod "5bc2cbca-07e7-4857-b075-31eaba6eabc5" (UID: "5bc2cbca-07e7-4857-b075-31eaba6eabc5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:50:12.858654 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.858623    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs" pod "5bc2cbca-07e7-4857-b075-31eaba6eabc5" (UID: "5bc2cbca-07e7-4857-b075-31eaba6eabc5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:50:12.858882 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.858861    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls" pod "5bc2cbca-07e7-4857-b075-31eaba6eabc5" (UID: "5bc2cbca-07e7-4857-b075-31eaba6eabc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:50:12.859031 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.859012    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr" pod "5bc2cbca-07e7-4857-b075-31eaba6eabc5" (UID: "5bc2cbca-07e7-4857-b075-31eaba6eabc5"). InnerVolumeSpecName "kube-api-access-d48hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:50:12.864178 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.864151    5579 generic.go:356] "Generic (PLEG): container finished" podID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerID="3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e" exitCode=0
Oct 30 22:50:12.864279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.864219    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"
Oct 30 22:50:12.864279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.864231    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" event={"ID":"5bc2cbca-07e7-4857-b075-31eaba6eabc5","Type":"ContainerDied","Data":"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"}
Oct 30 22:50:12.864404 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.864311    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p" event={"ID":"5bc2cbca-07e7-4857-b075-31eaba6eabc5","Type":"ContainerDied","Data":"b2bb1fc842449c2cdc0a47f818f53d4779d36ecc8ea7a8b0a095b9197c873969"}
Oct 30 22:50:12.864404 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.864334    5579 scope.go:122] "RemoveContainer" containerID="3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"
Oct 30 22:50:12.880993 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.880971    5579 scope.go:122] "RemoveContainer" containerID="3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"
Oct 30 22:50:12.881284 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:50:12.881263    5579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e\": container with ID starting with 3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e not found: ID does not exist" containerID="3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"
Oct 30 22:50:12.881363 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.881294    5579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e"} err="failed to get container status \"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e\": rpc error: code = NotFound desc = could not find container \"3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e\": container with ID starting with 3d04c2c2db587d7bc8c67162e4add1d0078c815bf413e8a56744d2b7921a2e0e not found: ID does not exist"
Oct 30 22:50:12.931208 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:50:12.931118    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:50:12.957472 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.957446    5579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc2cbca-07e7-4857-b075-31eaba6eabc5-openshift-service-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:12.957472 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.957469    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d48hr\" (UniqueName: \"kubernetes.io/projected/5bc2cbca-07e7-4857-b075-31eaba6eabc5-kube-api-access-d48hr\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:12.957472 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.957481    5579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-metrics-certs\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:12.957701 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:12.957489    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc2cbca-07e7-4857-b075-31eaba6eabc5-maas-api-tls\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:13.008056 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:13.008025    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 22:50:13.012565 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:13.012537    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-797f8b87df-xqw8p"]
Oct 30 22:50:13.146805 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:13.146768    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" path="/var/lib/kubelet/pods/5bc2cbca-07e7-4857-b075-31eaba6eabc5/volumes"
Oct 30 22:50:37.963228 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:37.963188    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"]
Oct 30 22:50:37.963731 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:37.963610    5579 cpu_manager.go:414] "containerMap: removing container" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerName="maas-api"
Oct 30 22:50:37.963731 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:37.963625    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerName="maas-api"
Oct 30 22:50:37.963731 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:37.963699    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bc2cbca-07e7-4857-b075-31eaba6eabc5" containerName="maas-api"
Oct 30 22:50:37.966813 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:37.966790    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.015671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.015642    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:50:38.015954 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.015753    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-969f6\""
Oct 30 22:50:38.042994 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.042968    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"]
Oct 30 22:50:38.103399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.103359    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.103399 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.103401    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lphm\" (UniqueName: \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.103608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.103559    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.205123 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.205085    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.205328 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.205178    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.205328 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.205210    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lphm\" (UniqueName: \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.205844 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.205823    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.207379 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.207353    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.259229 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.259160    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lphm\" (UniqueName: \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\") pod \"maas-api-revoke-keys-e2e-ait-8756f17a-782s7\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.280643 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.280611    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:38.647783 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:38.647737    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"]
Oct 30 22:50:38.654384 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:50:38.654354    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119cce27_6b13_4617_87b2_cf916216631f.slice/crio-dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048 WatchSource:0}: Error finding container dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048: Status 404 returned error can't find the container with id dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048
Oct 30 22:50:39.002134 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:39.002096    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7" event={"ID":"119cce27-6b13-4617-87b2-cf916216631f","Type":"ContainerStarted","Data":"af7c92d1cfcedf7ebd952483fe17b6009f5dfc0777a9352348f40cce22a173bf"}
Oct 30 22:50:39.002509 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:39.002159    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7" event={"ID":"119cce27-6b13-4617-87b2-cf916216631f","Type":"ContainerStarted","Data":"dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048"}
Oct 30 22:50:39.109561 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:39.109509    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7" podStartSLOduration=2.109494334 podStartE2EDuration="2.109494334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:50:39.10866044 +0000 UTC m=+4044.078506850" watchObservedRunningTime="2026-10-30 22:50:39.109494334 +0000 UTC m=+4044.079340743"
Oct 30 22:50:40.008375 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:40.008339    5579 generic.go:356] "Generic (PLEG): container finished" podID="119cce27-6b13-4617-87b2-cf916216631f" containerID="af7c92d1cfcedf7ebd952483fe17b6009f5dfc0777a9352348f40cce22a173bf" exitCode=0
Oct 30 22:50:40.008790 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:40.008384    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7" event={"ID":"119cce27-6b13-4617-87b2-cf916216631f","Type":"ContainerDied","Data":"af7c92d1cfcedf7ebd952483fe17b6009f5dfc0777a9352348f40cce22a173bf"}
Oct 30 22:50:41.150371 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.150345    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:41.234534 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.234497    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\" (UniqueName: \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\") pod \"119cce27-6b13-4617-87b2-cf916216631f\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") "
Oct 30 22:50:41.234748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.234555    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\") pod \"119cce27-6b13-4617-87b2-cf916216631f\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") "
Oct 30 22:50:41.234748 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.234675    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\") pod \"119cce27-6b13-4617-87b2-cf916216631f\" (UID: \"119cce27-6b13-4617-87b2-cf916216631f\") "
Oct 30 22:50:41.234921 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.234898    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca" pod "119cce27-6b13-4617-87b2-cf916216631f" (UID: "119cce27-6b13-4617-87b2-cf916216631f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:50:41.236799 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.236770    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm" pod "119cce27-6b13-4617-87b2-cf916216631f" (UID: "119cce27-6b13-4617-87b2-cf916216631f"). InnerVolumeSpecName "kube-api-access-6lphm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:50:41.236890 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.236829    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca" pod "119cce27-6b13-4617-87b2-cf916216631f" (UID: "119cce27-6b13-4617-87b2-cf916216631f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:50:41.335880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.335800    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/119cce27-6b13-4617-87b2-cf916216631f-maas-api-xks-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:41.335880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.335831    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lphm\" (UniqueName: \"kubernetes.io/projected/119cce27-6b13-4617-87b2-cf916216631f-kube-api-access-6lphm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:41.335880 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:41.335848    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/119cce27-6b13-4617-87b2-cf916216631f-maas-api-openshift-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:50:42.019504 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:42.019476    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"
Oct 30 22:50:42.019711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:42.019532    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7" event={"ID":"119cce27-6b13-4617-87b2-cf916216631f","Type":"ContainerDied","Data":"dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048"}
Oct 30 22:50:42.019711 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:42.019592    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dde183c3a4a1fb9fb3ec1a44b1b48fee62e4ea975a2b127b18cf54e178d96048"
Oct 30 22:50:42.929197 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:50:42.929160    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:50:57.596146 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:57.596065    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"]
Oct 30 22:50:57.642278 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:57.642246    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8756f17a-782s7"]
Oct 30 22:50:59.145011 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:50:59.144963    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="119cce27-6b13-4617-87b2-cf916216631f" path="/var/lib/kubelet/pods/119cce27-6b13-4617-87b2-cf916216631f/volumes"
Oct 30 22:51:12.930391 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:51:12.930350    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:51:42.929269 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:51:42.929230    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:52:12.929088 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:52:12.929049    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:52:42.930351 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:52:42.930272    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:52:50.682600 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.682567    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"]
Oct 30 22:52:50.683109 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.682982    5579 cpu_manager.go:414] "containerMap: removing container" podUID="119cce27-6b13-4617-87b2-cf916216631f" containerName="revoke-keys"
Oct 30 22:52:50.683109 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.682995    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="119cce27-6b13-4617-87b2-cf916216631f" containerName="revoke-keys"
Oct 30 22:52:50.683109 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.683070    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="119cce27-6b13-4617-87b2-cf916216631f" containerName="revoke-keys"
Oct 30 22:52:50.686158 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.686140    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.734637 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.734596    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:52:50.766898 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.766861    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.767125 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.767061    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwnb\" (UniqueName: \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.767125 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.767095    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.780809 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.780780    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-969f6\""
Oct 30 22:52:50.782644 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.782621    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"]
Oct 30 22:52:50.868213 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.868178    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.868440 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.868282    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwnb\" (UniqueName: \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.868440 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.868302    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.868990 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.868965    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.870507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.870485    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.922619 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.922582    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwnb\" (UniqueName: \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\") pod \"maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:50.998529 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:50.998437    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:51.366333 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:51.366251    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"]
Oct 30 22:52:51.372790 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:52:51.372761    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959b0c63_7ff4_4ae0_b873_d0553cbb7b77.slice/crio-fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7 WatchSource:0}: Error finding container fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7: Status 404 returned error can't find the container with id fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7
Oct 30 22:52:51.677013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:51.676966    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w" event={"ID":"959b0c63-7ff4-4ae0-b873-d0553cbb7b77","Type":"ContainerStarted","Data":"94e858028d0f0a1e34307d5da54ab69834d359b48c99b398cd1c958a4087c2de"}
Oct 30 22:52:51.677220 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:51.677044    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w" event={"ID":"959b0c63-7ff4-4ae0-b873-d0553cbb7b77","Type":"ContainerStarted","Data":"fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7"}
Oct 30 22:52:51.783910 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:51.783853    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w" podStartSLOduration=1.783838722 podStartE2EDuration="1.783838722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:52:51.78312798 +0000 UTC m=+4176.752974391" watchObservedRunningTime="2026-10-30 22:52:51.783838722 +0000 UTC m=+4176.753685130"
Oct 30 22:52:52.683602 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:52.683565    5579 generic.go:356] "Generic (PLEG): container finished" podID="959b0c63-7ff4-4ae0-b873-d0553cbb7b77" containerID="94e858028d0f0a1e34307d5da54ab69834d359b48c99b398cd1c958a4087c2de" exitCode=0
Oct 30 22:52:52.683796 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:52.683623    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w" event={"ID":"959b0c63-7ff4-4ae0-b873-d0553cbb7b77","Type":"ContainerDied","Data":"94e858028d0f0a1e34307d5da54ab69834d359b48c99b398cd1c958a4087c2de"}
Oct 30 22:52:53.825621 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:53.825593    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:53.997984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:53.997865    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\") pod \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") "
Oct 30 22:52:53.997984 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:53.997978    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\") pod \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") "
Oct 30 22:52:53.998239 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:53.998052    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\" (UniqueName: \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\") pod \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\" (UID: \"959b0c63-7ff4-4ae0-b873-d0553cbb7b77\") "
Oct 30 22:52:53.998432 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:53.998400    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca" pod "959b0c63-7ff4-4ae0-b873-d0553cbb7b77" (UID: "959b0c63-7ff4-4ae0-b873-d0553cbb7b77"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:52:54.000064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.000033    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca" pod "959b0c63-7ff4-4ae0-b873-d0553cbb7b77" (UID: "959b0c63-7ff4-4ae0-b873-d0553cbb7b77"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:52:54.000235 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.000209    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb" pod "959b0c63-7ff4-4ae0-b873-d0553cbb7b77" (UID: "959b0c63-7ff4-4ae0-b873-d0553cbb7b77"). InnerVolumeSpecName "kube-api-access-hkwnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:52:54.099321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.099283    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-xks-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:52:54.099321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.099319    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-maas-api-openshift-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:52:54.099321 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.099330    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkwnb\" (UniqueName: \"kubernetes.io/projected/959b0c63-7ff4-4ae0-b873-d0553cbb7b77-kube-api-access-hkwnb\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:52:54.695135 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.695098    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w" event={"ID":"959b0c63-7ff4-4ae0-b873-d0553cbb7b77","Type":"ContainerDied","Data":"fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7"}
Oct 30 22:52:54.695310 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.695146    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"
Oct 30 22:52:54.695310 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:52:54.695158    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe61141fad864ca2af5853e372bd7fcda571ffe5d831a9ef384586ad4fae49c7"
Oct 30 22:53:12.929367 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:53:12.929330    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:53:15.789451 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:15.789418    5579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"]
Oct 30 22:53:15.835678 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:15.835630    5579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-8a1d54-xqt6w"]
Oct 30 22:53:17.146317 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:17.146281    5579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="959b0c63-7ff4-4ae0-b873-d0553cbb7b77" path="/var/lib/kubelet/pods/959b0c63-7ff4-4ae0-b873-d0553cbb7b77/volumes"
Oct 30 22:53:42.937606 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:53:42.937479    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:53:50.304173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.304140    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"]
Oct 30 22:53:50.304671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.304528    5579 cpu_manager.go:414] "containerMap: removing container" podUID="959b0c63-7ff4-4ae0-b873-d0553cbb7b77" containerName="revoke-keys"
Oct 30 22:53:50.304671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.304540    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="959b0c63-7ff4-4ae0-b873-d0553cbb7b77" containerName="revoke-keys"
Oct 30 22:53:50.304671 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.304626    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="959b0c63-7ff4-4ae0-b873-d0553cbb7b77" containerName="revoke-keys"
Oct 30 22:53:50.311085 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.309426    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.356138 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.356107    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhrhm\" (UniqueName: \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.356282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.356150    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.356282 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.356177    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.358439 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.358421    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:53:50.404153 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.404126    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-969f6\""
Oct 30 22:53:50.406064 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.406043    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"]
Oct 30 22:53:50.457121 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.457087    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhrhm\" (UniqueName: \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.457290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.457132    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.457290 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.457156    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.457915 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.457888    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.459606 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.459582    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.510513 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.510486    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhrhm\" (UniqueName: \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\") pod \"maas-api-revoke-sub-f03629db-qrb48\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.623637 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.623559    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:50.989203 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:50.989169    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"]
Oct 30 22:53:50.996989 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:53:50.996959    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530290d9_2481_485c_84ab_151cb3cccc03.slice/crio-df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244 WatchSource:0}: Error finding container df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244: Status 404 returned error can't find the container with id df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244
Oct 30 22:53:51.017529 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:51.017495    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48" event={"ID":"530290d9-2481-485c-84ab-151cb3cccc03","Type":"ContainerStarted","Data":"df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244"}
Oct 30 22:53:52.024873 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:52.024838    5579 generic.go:356] "Generic (PLEG): container finished" podID="530290d9-2481-485c-84ab-151cb3cccc03" containerID="072bd6c12a3420848b7ce301b92a94837c15b5cf3e7fe41bce2f502be2faa1b6" exitCode=0
Oct 30 22:53:52.025303 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:52.024924    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48" event={"ID":"530290d9-2481-485c-84ab-151cb3cccc03","Type":"ContainerDied","Data":"072bd6c12a3420848b7ce301b92a94837c15b5cf3e7fe41bce2f502be2faa1b6"}
Oct 30 22:53:53.158156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.158133    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:53.182002 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.181974    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\" (UniqueName: \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\") pod \"530290d9-2481-485c-84ab-151cb3cccc03\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") "
Oct 30 22:53:53.182132 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.182024    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\") pod \"530290d9-2481-485c-84ab-151cb3cccc03\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") "
Oct 30 22:53:53.182132 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.182100    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\") pod \"530290d9-2481-485c-84ab-151cb3cccc03\" (UID: \"530290d9-2481-485c-84ab-151cb3cccc03\") "
Oct 30 22:53:53.182488 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.182463    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca" pod "530290d9-2481-485c-84ab-151cb3cccc03" (UID: "530290d9-2481-485c-84ab-151cb3cccc03"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:53:53.183964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.183917    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm" pod "530290d9-2481-485c-84ab-151cb3cccc03" (UID: "530290d9-2481-485c-84ab-151cb3cccc03"). InnerVolumeSpecName "kube-api-access-dhrhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:53:53.184050 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.184016    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca" pod "530290d9-2481-485c-84ab-151cb3cccc03" (UID: "530290d9-2481-485c-84ab-151cb3cccc03"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:53:53.283160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.283093    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-openshift-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:53:53.283160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.283119    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhrhm\" (UniqueName: \"kubernetes.io/projected/530290d9-2481-485c-84ab-151cb3cccc03-kube-api-access-dhrhm\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:53:53.283160 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:53.283130    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/530290d9-2481-485c-84ab-151cb3cccc03-maas-api-xks-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:53:54.036551 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:54.036522    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48"
Oct 30 22:53:54.036551 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:54.036547    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-qrb48" event={"ID":"530290d9-2481-485c-84ab-151cb3cccc03","Type":"ContainerDied","Data":"df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244"}
Oct 30 22:53:54.036775 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:53:54.036589    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df6cf3f4b2060295db2cc9da931b3ccd39185a8f83720cac4ef379199dfc0244"
Oct 30 22:54:11.220616 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.220583    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"]
Oct 30 22:54:11.221043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.220991    5579 cpu_manager.go:414] "containerMap: removing container" podUID="530290d9-2481-485c-84ab-151cb3cccc03" containerName="revoke-keys"
Oct 30 22:54:11.221043 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.221005    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="530290d9-2481-485c-84ab-151cb3cccc03" containerName="revoke-keys"
Oct 30 22:54:11.221134 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.221077    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="530290d9-2481-485c-84ab-151cb3cccc03" containerName="revoke-keys"
Oct 30 22:54:11.224636 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.224612    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.319704 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.319671    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:54:11.319863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.319738    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-969f6\""
Oct 30 22:54:11.321848 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.321829    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"]
Oct 30 22:54:11.400033 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.399997    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.400208 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.400044    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dmx\" (UniqueName: \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.400208 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.400125    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.500686 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.500601    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.500855 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.500696    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.500855 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.500726    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dmx\" (UniqueName: \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.501277 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.501255    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.503059 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.503040    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.555553 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.555527    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dmx\" (UniqueName: \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\") pod \"maas-api-revoke-sub-0165d7d2-5vkxf\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:11.837702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:11.837619    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:12.209533 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:12.209501    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"]
Oct 30 22:54:12.216312 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:54:12.216275    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5601c016_20bd_4f53_997a_f5e293a3d7ea.slice/crio-930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771 WatchSource:0}: Error finding container 930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771: Status 404 returned error can't find the container with id 930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771
Oct 30 22:54:12.929725 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:54:12.929686    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:54:13.186295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:13.186221    5579 generic.go:356] "Generic (PLEG): container finished" podID="5601c016-20bd-4f53-997a-f5e293a3d7ea" containerID="178fa2d0e3e740b32d0cb36737dfd62f5d64f9040a137adeeeb981d778c3fc1c" exitCode=0
Oct 30 22:54:13.186295 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:13.186271    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf" event={"ID":"5601c016-20bd-4f53-997a-f5e293a3d7ea","Type":"ContainerDied","Data":"178fa2d0e3e740b32d0cb36737dfd62f5d64f9040a137adeeeb981d778c3fc1c"}
Oct 30 22:54:13.186488 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:13.186310    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf" event={"ID":"5601c016-20bd-4f53-997a-f5e293a3d7ea","Type":"ContainerStarted","Data":"930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771"}
Oct 30 22:54:14.322863 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.322837    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:14.327884 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.327862    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\") pod \"5601c016-20bd-4f53-997a-f5e293a3d7ea\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") "
Oct 30 22:54:14.328088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.327959    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\") pod \"5601c016-20bd-4f53-997a-f5e293a3d7ea\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") "
Oct 30 22:54:14.328088 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.328005    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\" (UniqueName: \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\") pod \"5601c016-20bd-4f53-997a-f5e293a3d7ea\" (UID: \"5601c016-20bd-4f53-997a-f5e293a3d7ea\") "
Oct 30 22:54:14.328348 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.328324    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca" pod "5601c016-20bd-4f53-997a-f5e293a3d7ea" (UID: "5601c016-20bd-4f53-997a-f5e293a3d7ea"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:54:14.329911 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.329886    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx" pod "5601c016-20bd-4f53-997a-f5e293a3d7ea" (UID: "5601c016-20bd-4f53-997a-f5e293a3d7ea"). InnerVolumeSpecName "kube-api-access-j2dmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:54:14.330035 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.329946    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca" pod "5601c016-20bd-4f53-997a-f5e293a3d7ea" (UID: "5601c016-20bd-4f53-997a-f5e293a3d7ea"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:54:14.429069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.429031    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-xks-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:14.429069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.429063    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5601c016-20bd-4f53-997a-f5e293a3d7ea-maas-api-openshift-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:14.429069 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:14.429074    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2dmx\" (UniqueName: \"kubernetes.io/projected/5601c016-20bd-4f53-997a-f5e293a3d7ea-kube-api-access-j2dmx\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:15.197243 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:15.197204    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf" event={"ID":"5601c016-20bd-4f53-997a-f5e293a3d7ea","Type":"ContainerDied","Data":"930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771"}
Oct 30 22:54:15.197402 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:15.197261    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="930bf49e6b4a8840b6f02da7f8d8197fd9912b99c47825babfa87e6e8ce54771"
Oct 30 22:54:15.197402 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:15.197216    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-5vkxf"
Oct 30 22:54:22.875489 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.875450    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"]
Oct 30 22:54:22.876021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.875868    5579 cpu_manager.go:414] "containerMap: removing container" podUID="5601c016-20bd-4f53-997a-f5e293a3d7ea" containerName="revoke-keys"
Oct 30 22:54:22.876021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.875880    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5601c016-20bd-4f53-997a-f5e293a3d7ea" containerName="revoke-keys"
Oct 30 22:54:22.876021 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.875971    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="5601c016-20bd-4f53-997a-f5e293a3d7ea" containerName="revoke-keys"
Oct 30 22:54:22.879034 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.879014    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:22.898994 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.898969    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:22.899101 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.899079    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8mk\" (UniqueName: \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:22.899141 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.899106    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:22.930193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.930168    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:54:22.930193 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.930190    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-969f6\""
Oct 30 22:54:22.977377 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:22.977346    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"]
Oct 30 22:54:23.000469 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.000442    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8mk\" (UniqueName: \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.000469 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.000474    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.000693 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.000523    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.001200 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.001177    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.002669 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.002647    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.053938 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.053901    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8mk\" (UniqueName: \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\") pod \"maas-api-revoke-sub-6b19338f-pd8qb\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.191849 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.191819    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:23.561964 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:23.561863    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"]
Oct 30 22:54:23.568670 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:54:23.568641    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772b27bc_a06c_487a_81c2_4077ba8fea9a.slice/crio-b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c WatchSource:0}: Error finding container b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c: Status 404 returned error can't find the container with id b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c
Oct 30 22:54:24.246315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:24.246281    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb" event={"ID":"772b27bc-a06c-487a-81c2-4077ba8fea9a","Type":"ContainerStarted","Data":"738f3add5b41924b0859835cf851069109235c6a43cb512875e6b028311d3d7f"}
Oct 30 22:54:24.246785 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:24.246335    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb" event={"ID":"772b27bc-a06c-487a-81c2-4077ba8fea9a","Type":"ContainerStarted","Data":"b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c"}
Oct 30 22:54:24.354428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:24.354373    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb" podStartSLOduration=2.35435766 podStartE2EDuration="2.35435766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:54:24.352981162 +0000 UTC m=+4269.322827574" watchObservedRunningTime="2026-10-30 22:54:24.35435766 +0000 UTC m=+4269.324204069"
Oct 30 22:54:25.253327 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:25.253290    5579 generic.go:356] "Generic (PLEG): container finished" podID="772b27bc-a06c-487a-81c2-4077ba8fea9a" containerID="738f3add5b41924b0859835cf851069109235c6a43cb512875e6b028311d3d7f" exitCode=0
Oct 30 22:54:25.253720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:25.253378    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb" event={"ID":"772b27bc-a06c-487a-81c2-4077ba8fea9a","Type":"ContainerDied","Data":"738f3add5b41924b0859835cf851069109235c6a43cb512875e6b028311d3d7f"}
Oct 30 22:54:26.392918 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.392890    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:26.434173 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.434140    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\") pod \"772b27bc-a06c-487a-81c2-4077ba8fea9a\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") "
Oct 30 22:54:26.434307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.434201    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\") pod \"772b27bc-a06c-487a-81c2-4077ba8fea9a\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") "
Oct 30 22:54:26.434307 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.434270    5579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\" (UniqueName: \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\") pod \"772b27bc-a06c-487a-81c2-4077ba8fea9a\" (UID: \"772b27bc-a06c-487a-81c2-4077ba8fea9a\") "
Oct 30 22:54:26.434528 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.434504    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca" pod "772b27bc-a06c-487a-81c2-4077ba8fea9a" (UID: "772b27bc-a06c-487a-81c2-4077ba8fea9a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:54:26.436350 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.436319    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk" pod "772b27bc-a06c-487a-81c2-4077ba8fea9a" (UID: "772b27bc-a06c-487a-81c2-4077ba8fea9a"). InnerVolumeSpecName "kube-api-access-9c8mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:54:26.436445 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.436397    5579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca" pod "772b27bc-a06c-487a-81c2-4077ba8fea9a" (UID: "772b27bc-a06c-487a-81c2-4077ba8fea9a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:54:26.536018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.535942    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-xks-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:26.536018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.535970    5579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c8mk\" (UniqueName: \"kubernetes.io/projected/772b27bc-a06c-487a-81c2-4077ba8fea9a-kube-api-access-9c8mk\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:26.536018 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:26.535982    5579 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/772b27bc-a06c-487a-81c2-4077ba8fea9a-maas-api-openshift-ca\") on node \"ip-10-0-139-66.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 22:54:27.264761 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:27.264731    5579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb"
Oct 30 22:54:27.264947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:27.264761    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-pd8qb" event={"ID":"772b27bc-a06c-487a-81c2-4077ba8fea9a","Type":"ContainerDied","Data":"b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c"}
Oct 30 22:54:27.264947 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:27.264811    5579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b62f2e004d8fa83a7ba45ad634f60cdb4eb88d38b78fad033e010b7d5926f98c"
Oct 30 22:54:42.929382 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:54:42.929339    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:54:46.757234 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:46.757204    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-qxzff_a119f87c-e73c-42f5-a012-fbe11436e92f/manager/0.log"
Oct 30 22:54:47.002087 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:47.002061    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-4jhqj_5a3ccb59-fc2b-4a72-b415-8e43a60f5be4/manager/0.log"
Oct 30 22:54:47.349045 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:47.349013    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-w78lq_87ba9dc9-17a1-4361-9f75-d91c72e1d7d1/manager/0.log"
Oct 30 22:54:48.156629 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:48.156598    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-xzghp_69ab7af8-bde2-475a-8077-051735a3f3a2/server/0.log"
Oct 30 22:54:48.402468 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:48.402439    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-4jbjt_f347f2c6-60fb-48b2-8fd9-11e9305a4b0b/manager/0.log"
Oct 30 22:54:49.885864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:49.885830    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-5vkxf_5601c016-20bd-4f53-997a-f5e293a3d7ea/revoke-keys/0.log"
Oct 30 22:54:50.106013 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:50.105982    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-pd8qb_772b27bc-a06c-487a-81c2-4077ba8fea9a/revoke-keys/0.log"
Oct 30 22:54:50.337219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:50.337138    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-qrb48_530290d9-2481-485c-84ab-151cb3cccc03/revoke-keys/0.log"
Oct 30 22:54:50.552420 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:50.552391    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-sb4lj_ff670e45-2e5b-49d6-8fa8-95f9f117c8d8/postgres/0.log"
Oct 30 22:54:53.067026 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:53.067000    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xv78j_df20a534-e1fa-47ec-8147-2af4fd7ff8e8/kuadrant-console-plugin/0.log"
Oct 30 22:54:55.338632 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:55.338600    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78776654bd-zqbr7_548a274d-6378-40b4-95e4-7f910b39f11e/kube-auth-proxy/0.log"
Oct 30 22:54:55.795111 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:55.795074    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-5mdln_92896565-25f6-44a4-9abb-2ebaedb4b6d4/istio-proxy/0.log"
Oct 30 22:54:57.067225 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:57.067193    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-bqvsj_c709a8ea-0fca-4747-b509-065c9ae96348/istio-proxy/0.log"
Oct 30 22:54:57.904692 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:54:57.904658    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-z89qz_e480602c-5242-405c-9fcb-7e7f0525f402/istio-proxy/0.log"
Oct 30 22:55:12.156766 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:12.156729    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-qxzff_a119f87c-e73c-42f5-a012-fbe11436e92f/manager/0.log"
Oct 30 22:55:12.444228 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:12.444148    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-4jhqj_5a3ccb59-fc2b-4a72-b415-8e43a60f5be4/manager/0.log"
Oct 30 22:55:12.792156 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:12.792073    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-w78lq_87ba9dc9-17a1-4361-9f75-d91c72e1d7d1/manager/0.log"
Oct 30 22:55:12.929891 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:55:12.929849    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:55:13.484024 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:13.483992    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-xzghp_69ab7af8-bde2-475a-8077-051735a3f3a2/server/0.log"
Oct 30 22:55:13.729608 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:13.729575    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-4jbjt_f347f2c6-60fb-48b2-8fd9-11e9305a4b0b/manager/0.log"
Oct 30 22:55:15.122757 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:15.122731    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-5vkxf_5601c016-20bd-4f53-997a-f5e293a3d7ea/revoke-keys/0.log"
Oct 30 22:55:15.345120 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:15.345087    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-pd8qb_772b27bc-a06c-487a-81c2-4077ba8fea9a/revoke-keys/0.log"
Oct 30 22:55:15.563702 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:15.563664    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-qrb48_530290d9-2481-485c-84ab-151cb3cccc03/revoke-keys/0.log"
Oct 30 22:55:15.791434 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:15.791403    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-sb4lj_ff670e45-2e5b-49d6-8fa8-95f9f117c8d8/postgres/0.log"
Oct 30 22:55:17.905212 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:17.905180    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xv78j_df20a534-e1fa-47ec-8147-2af4fd7ff8e8/kuadrant-console-plugin/0.log"
Oct 30 22:55:19.973190 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:19.973159    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78776654bd-zqbr7_548a274d-6378-40b4-95e4-7f910b39f11e/kube-auth-proxy/0.log"
Oct 30 22:55:20.413273 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:20.413243    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-5mdln_92896565-25f6-44a4-9abb-2ebaedb4b6d4/istio-proxy/0.log"
Oct 30 22:55:21.639709 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:21.639679    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-bqvsj_c709a8ea-0fca-4747-b509-065c9ae96348/istio-proxy/0.log"
Oct 30 22:55:22.480507 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:55:22.480475    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-z89qz_e480602c-5242-405c-9fcb-7e7f0525f402/istio-proxy/0.log"
Oct 30 22:55:42.929008 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:55:42.928912    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:56:12.929311 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:56:12.929264    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:56:42.929063 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:56:42.929025    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"
Oct 30 22:56:43.994315 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:43.994277    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t84qg_9b2aa126-a4b7-4494-8325-a0e5af72a287/global-pull-secret-syncer/0.log"
Oct 30 22:56:47.248591 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:47.248556    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzx5c_f51df616-11c7-429e-a475-aeb655678373/konnectivity-agent/0.log"
Oct 30 22:56:48.587850 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:48.587823    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-66.us-west-2.compute.internal_4e63feea4e10327df2e22d81d9a9cb4a/haproxy/0.log"
Oct 30 22:56:53.845918 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.845800    5579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"]
Oct 30 22:56:53.849361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.847289    5579 cpu_manager.go:414] "containerMap: removing container" podUID="772b27bc-a06c-487a-81c2-4077ba8fea9a" containerName="revoke-keys"
Oct 30 22:56:53.849361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.847317    5579 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="772b27bc-a06c-487a-81c2-4077ba8fea9a" containerName="revoke-keys"
Oct 30 22:56:53.849361 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.847544    5579 memory_manager.go:365] "RemoveStaleState removing state" podUID="772b27bc-a06c-487a-81c2-4077ba8fea9a" containerName="revoke-keys"
Oct 30 22:56:53.851959 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.851728    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.874864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.874830    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-sys\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.874864 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.874869    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-lib-modules\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.875130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.874946    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-podres\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.875130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.875029    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-proc\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.875130 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.875071    5579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w6g9\" (UniqueName: \"kubernetes.io/projected/65950cf9-0125-4ab6-b345-42a44c7cf5b7-kube-api-access-4w6g9\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.900666 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.900640    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjhpl\"/\"openshift-service-ca.crt\""
Oct 30 22:56:53.946658 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.946624    5579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjhpl\"/\"kube-root-ca.crt\""
Oct 30 22:56:53.946872 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.946862    5579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjhpl\"/\"default-dockercfg-mpw92\""
Oct 30 22:56:53.949062 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.949039    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"]
Oct 30 22:56:53.976096 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976068    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w6g9\" (UniqueName: \"kubernetes.io/projected/65950cf9-0125-4ab6-b345-42a44c7cf5b7-kube-api-access-4w6g9\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976233 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976210    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-sys\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976234    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-lib-modules\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976279 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976266    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-podres\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976349 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976331    5579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-proc\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976349 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976330    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-sys\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976366    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-lib-modules\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976428 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976421    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-podres\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:53.976493 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:53.976455    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65950cf9-0125-4ab6-b345-42a44c7cf5b7-proc\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:54.030044 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:54.030014    5579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w6g9\" (UniqueName: \"kubernetes.io/projected/65950cf9-0125-4ab6-b345-42a44c7cf5b7-kube-api-access-4w6g9\") pod \"perf-node-gather-daemonset-v4fg9\" (UID: \"65950cf9-0125-4ab6-b345-42a44c7cf5b7\") " pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:54.032449 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:54.032427    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xv78j_df20a534-e1fa-47ec-8147-2af4fd7ff8e8/kuadrant-console-plugin/0.log"
Oct 30 22:56:54.165243 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:54.165215    5579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:54.541631 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:54.541544    5579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"]
Oct 30 22:56:54.548345 ip-10-0-139-66 kubenswrapper[5579]: W1030 22:56:54.548313    5579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65950cf9_0125_4ab6_b345_42a44c7cf5b7.slice/crio-792d09eea2bc8ac23c6f81c1de5596e77a348cc1b4a7f7ce05e8ee0079d57dba WatchSource:0}: Error finding container 792d09eea2bc8ac23c6f81c1de5596e77a348cc1b4a7f7ce05e8ee0079d57dba: Status 404 returned error can't find the container with id 792d09eea2bc8ac23c6f81c1de5596e77a348cc1b4a7f7ce05e8ee0079d57dba
Oct 30 22:56:55.038137 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:55.038105    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9" event={"ID":"65950cf9-0125-4ab6-b345-42a44c7cf5b7","Type":"ContainerStarted","Data":"1869fba1d18709390ba16f250f9a957ee9f9f261c926708db76ba3a08e3d9335"}
Oct 30 22:56:55.038650 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:55.038160    5579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9" event={"ID":"65950cf9-0125-4ab6-b345-42a44c7cf5b7","Type":"ContainerStarted","Data":"792d09eea2bc8ac23c6f81c1de5596e77a348cc1b4a7f7ce05e8ee0079d57dba"}
Oct 30 22:56:55.038650 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:55.038216    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:56:55.148063 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:56:55.147966    5579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9" podStartSLOduration=2.147948321 podStartE2EDuration="2.147948321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:55.146321337 +0000 UTC m=+4420.116167745" watchObservedRunningTime="2026-10-30 22:56:55.147948321 +0000 UTC m=+4420.117794732"
Oct 30 22:57:00.961219 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:00.961185    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5qmgm_552df7e5-21a9-499c-854d-f14654c5e442/kube-state-metrics/0.log"
Oct 30 22:57:01.054478 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:01.054452    5579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjhpl/perf-node-gather-daemonset-v4fg9"
Oct 30 22:57:01.419501 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:01.419467    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5qmgm_552df7e5-21a9-499c-854d-f14654c5e442/kube-rbac-proxy-main/0.log"
Oct 30 22:57:01.825591 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:01.825519    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5qmgm_552df7e5-21a9-499c-854d-f14654c5e442/kube-rbac-proxy-self/0.log"
Oct 30 22:57:02.237311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:02.237280    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b5c75f669-74m79_9bcf5bdf-5cf2-406e-8b17-796aa4178e88/metrics-server/0.log"
Oct 30 22:57:04.251358 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:04.251287    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5j5z_34fda3c0-2859-4e43-a320-fe86dfa0150b/node-exporter/0.log"
Oct 30 22:57:04.657350 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:04.657318    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5j5z_34fda3c0-2859-4e43-a320-fe86dfa0150b/kube-rbac-proxy/0.log"
Oct 30 22:57:05.066089 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:05.066009    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p5j5z_34fda3c0-2859-4e43-a320-fe86dfa0150b/init-textfile/0.log"
Oct 30 22:57:06.675191 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:06.675147    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-8hdmd_c01628e3-8e21-4385-a716-62fbc9adc347/kube-rbac-proxy-main/0.log"
Oct 30 22:57:07.082203 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:07.082122    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-8hdmd_c01628e3-8e21-4385-a716-62fbc9adc347/kube-rbac-proxy-self/0.log"
Oct 30 22:57:07.490673 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:07.490639    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-8hdmd_c01628e3-8e21-4385-a716-62fbc9adc347/openshift-state-metrics/0.log"
Oct 30 22:57:07.906498 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:07.906466    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/prometheus/0.log"
Oct 30 22:57:08.313311 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:08.313231    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/config-reloader/0.log"
Oct 30 22:57:08.720155 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:08.720128    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/thanos-sidecar/0.log"
Oct 30 22:57:09.126403 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:09.126333    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/kube-rbac-proxy-web/0.log"
Oct 30 22:57:09.550876 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:09.550844    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/kube-rbac-proxy/0.log"
Oct 30 22:57:09.959811 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:09.959778    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/kube-rbac-proxy-thanos/0.log"
Oct 30 22:57:10.367720 ip-10-0-139-66 kubenswrapper[5579]: I1030 22:57:10.367638    5579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83b5c3ec-9e57-44bb-9ec4-b5e8788c61fa/init-config-reloader/0.log"
Oct 30 22:57:12.929778 ip-10-0-139-66 kubenswrapper[5579]: E1030 22:57:12.929739    5579 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm5lq" containerName="extractor"