Oct 30 20:23:46.135745 ip-10-0-135-188 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 20:23:46.135755 ip-10-0-135-188 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 20:23:46.135763 ip-10-0-135-188 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 20:23:46.135985 ip-10-0-135-188 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 20:23:56.198712 ip-10-0-135-188 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 20:23:56.198751 ip-10-0-135-188 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot edc6e22ef8cb424aa9c92fae1b7a5699 --
Oct 30 20:25:59.953191 ip-10-0-135-188 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:26:00.356461 ip-10-0-135-188 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:26:00.356461 ip-10-0-135-188 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:26:00.356461 ip-10-0-135-188 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:26:00.356461 ip-10-0-135-188 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:26:00.361605 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361532    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.361605 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361605    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361609    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361612    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361615    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361618    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361621    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361623    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361626    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361629    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361632    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361634    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361637    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361640    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361642    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361645    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361647    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361651    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361662    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361665    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.361675 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361668    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361671    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361673    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361676    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361679    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361682    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361685    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361688    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361691    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361694    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361696    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361699    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361702    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361704    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361707    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361710    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361712    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361715    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361717    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361720    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.362126 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361722    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361725    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361756    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361761    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361764    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361768    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361771    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361774    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361778    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361781    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361783    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361786    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361789    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361792    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361795    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361798    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361800    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361803    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361806    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361808    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.362586 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361811    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361814    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361816    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361819    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361821    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361824    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361826    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361830    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361833    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361836    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361839    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361841    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361844    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361847    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361849    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361852    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361854    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361857    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361859    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.363104 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361862    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361864    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361867    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361870    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361873    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361879    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361882    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361885    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361887    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361890    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361892    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361895    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361897    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361900    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361903    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361905    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361908    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361910    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361927    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361930    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.363543 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361932    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361935    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361937    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361940    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361942    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361945    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.361949    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362720    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362727    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362730    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362733    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362736    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362739    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362742    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362745    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362747    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362750    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362753    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362764    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362767    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.364008 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362770    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362773    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362775    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362778    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362780    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362783    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362786    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362788    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362790    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362793    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362796    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362798    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362801    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362803    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362806    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362808    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362811    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362813    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362816    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.364484 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362833    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362838    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362841    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362844    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362846    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362849    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362852    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362855    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362858    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362860    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362863    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362866    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362869    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362872    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362874    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362877    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362881    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362885    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362887    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362890    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.364949 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362893    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362895    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362898    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362901    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362903    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362906    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362908    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362911    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362941    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362944    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362946    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362949    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362952    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362954    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362957    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362959    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362962    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362964    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362968    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.365424 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362971    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362973    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362976    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362978    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362981    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362984    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362988    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362990    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362993    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362995    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.362998    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363001    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363003    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363006    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363008    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363013    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363017    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363020    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363022    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363025    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.365930 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363028    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363030    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363033    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363035    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363038    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363041    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363043    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363046    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363048    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363051    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363053    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363056    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363059    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363062    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363064    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363538    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363543    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363546    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363549    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363554    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.366404 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363557    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363560    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363563    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363565    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363568    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363571    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363574    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363577    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363580    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363582    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363585    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363588    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363590    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363593    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363595    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363598    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363600    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363603    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363605    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.366857 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363608    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363610    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363613    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363616    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363619    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363623    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363626    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363630    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363633    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363635    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363638    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363641    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363644    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363646    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363649    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363651    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363654    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363656    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363659    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.367316 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363676    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363680    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363684    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363686    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363689    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363692    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363694    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363697    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363699    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363702    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363705    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363707    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363710    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363712    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363717    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363720    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363723    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363725    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363728    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363731    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.367752 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363733    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363736    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363738    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363741    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363744    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363746    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363749    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363752    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363755    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363757    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363760    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363762    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363765    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363767    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363770    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363772    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363775    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363777    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363780    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.368246 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363782    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363785    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363787    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363790    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363792    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363795    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363797    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363801    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363804    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363806    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363809    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363811    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363814    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363817    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363821    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363824    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363827    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363830    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363833    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363835    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.368679 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363840    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363843    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363846    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.363848    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363941    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363950    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363959    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363966    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363972    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363976    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363980    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363984    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363987    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363990    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363994    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.363997    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364000    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364002    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364005    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364010    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364012    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364015    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364035    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364039    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:26:00.369164 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364042    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364045    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364049    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364053    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364056    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364059    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364062    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364065    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364068    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364072    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364075    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364078    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364082    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364085    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364088    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364091    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364094    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364096    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364101    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364104    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364107    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364110    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364113    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364120    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:26:00.369710 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364123    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364127    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364130    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364134    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364137    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364140    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364143    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364145    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364148    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364151    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364155    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364158    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364161    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364164    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364168    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364171    2577 flags.go:64] FLAG: --help="false"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364174    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364177    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364180    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364183    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364186    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364190    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364193    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:26:00.370328 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364195    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364198    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364201    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364203    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364206    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364209    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364212    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364215    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364218    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364220    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364223    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364226    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364229    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364232    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364238    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364241    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364244    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364247    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364250    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364253    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364256    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364259    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364263    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364266    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364270    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:26:00.370866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364273    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364276    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364278    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364282    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364285    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364288    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364290    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364297    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364300    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364303    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364306    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364309    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364311    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364315    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364318    2577 flags.go:64] FLAG: --port="10250"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364321    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364323    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-09c829cd118fbec6a"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364327    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364329    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364332    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364336    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364340    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364343    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364345    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364348    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364352    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:26:00.371467 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364355    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364358    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364361    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364364    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364367    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364370    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364372    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364375    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364378    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364381    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364384    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364388    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364391    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364393    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364396    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364399    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364402    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364405    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364407    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364413    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364415    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364418    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364422    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364425    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364428    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:26:00.372082 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364431    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364434    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364437    2577 flags.go:64] FLAG: --v="2"
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364441    2577 flags.go:64] FLAG: --version="false"
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364445    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364449    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364452    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364583    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364587    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364590    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364593    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364597    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364600    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364603    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364605    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364608    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364610    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364613    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364616    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364619    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364621    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.372947 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364624    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364626    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364629    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364631    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364634    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364638    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364640    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364643    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364645    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364648    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364650    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364653    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364655    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364658    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364661    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364663    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364666    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364668    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364673    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364675    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.373762 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364678    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364680    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364683    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364686    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364688    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364691    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364693    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364696    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364698    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364701    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364704    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364707    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364709    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364712    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364714    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364717    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364720    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364724    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364726    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364729    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.374269 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364732    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364735    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364737    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364740    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364742    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364745    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364748    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364750    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364753    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364756    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364760    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364762    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364765    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364767    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364770    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364772    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364776    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364780    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364783    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364787    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.374746 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364790    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364793    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364795    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364798    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364802    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364806    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364809    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364812    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364815    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364819    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364821    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364824    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364826    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364829    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364832    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364834    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364837    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364839    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364842    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.375266 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364844    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364847    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364850    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364854    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364857    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364859    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364862    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364865    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364867    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364870    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364872    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364875    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364877    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.364903    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364960    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364966    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.375711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364969    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364972    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364975    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364978    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364980    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364983    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364985    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364990    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364992    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364995    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.364998    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365000    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365003    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365005    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365008    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365010    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365013    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365016    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365018    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.376108 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365023    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365027    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365030    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365033    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365036    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365038    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365041    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365043    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365047    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365051    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365054    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365057    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365060    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365062    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365065    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365068    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365070    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365073    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365076    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.376538 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365078    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365082    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365085    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365087    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365090    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365092    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365095    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365097    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365099    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365102    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365104    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365107    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365109    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365113    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365116    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365118    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365120    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365123    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365125    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.376992 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365128    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365131    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365133    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365136    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365138    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365141    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365143    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365146    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365148    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365150    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365153    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365156    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365158    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365161    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365165    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365168    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365170    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365173    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365175    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365178    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.377472 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365180    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365183    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365185    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365188    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365190    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365193    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365197    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365199    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365202    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365205    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365208    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365210    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365213    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365215    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365218    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365220    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365223    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365225    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365228    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365231    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.377979 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365233    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365235    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365238    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365242    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365244    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365247    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.365250    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.373801    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.373815    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.373834    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.373839    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373895    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373900    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373903    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373906    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373909    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373932    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373936    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373940    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373943    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.378455 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373946    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373949    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373951    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373954    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373956    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373959    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373961    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373964    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373967    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373970    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373974    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373978    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373981    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373984    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373987    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373990    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373993    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373996    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.373999    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.378909 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374002    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374005    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374007    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374010    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374012    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374015    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374017    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374020    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374022    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374025    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374027    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374030    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374033    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374035    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374037    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374040    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374042    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374045    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374049    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.379370 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374052    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374054    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374057    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374059    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374062    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374064    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374067    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374069    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374072    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374074    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374077    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374079    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374083    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374087    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374090    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374093    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374095    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374098    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374101    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374103    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.379801 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374106    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374108    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374111    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374113    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374116    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374118    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374121    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374123    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374126    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374128    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374131    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374133    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374137    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374140    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374142    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374145    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374147    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374150    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374152    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374155    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.380309 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374158    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374160    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374162    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374165    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374168    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374170    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374172    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374176    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374178    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374181    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374183    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374186    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374188    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374190    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374193    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374195    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374198    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374201    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.380803 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374203    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.374232    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374366    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374371    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374373    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374377    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374379    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374383    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374386    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374388    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374391    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374394    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374396    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374399    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374401    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374404    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.381231 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374406    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374409    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374412    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374414    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374417    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374420    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374422    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374425    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374427    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374430    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374432    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374435    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374437    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374440    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374443    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374445    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374447    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374450    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374454    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.381608 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374457    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374460    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374463    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374465    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374469    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374472    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374475    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374478    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374480    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374482    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374485    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374487    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374490    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374492    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374495    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374497    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374500    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374503    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374505    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374508    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.382132 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374510    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374513    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374515    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374518    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374520    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374523    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374525    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374528    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374531    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374533    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374536    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374538    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374541    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374544    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374546    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374548    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374551    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374554    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374557    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374560    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.382581 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374562    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374564    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374567    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374569    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374572    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374574    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374577    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374580    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374582    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374585    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374587    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374590    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374592    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374595    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374597    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374600    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374602    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374607    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374609    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374612    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.383062 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374614    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374617    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374619    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374622    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374624    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374627    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374629    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374631    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374634    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374636    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374639    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374642    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374644    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.374667    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374698    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374702    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:26:00.383654 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374706    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374712    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374715    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374718    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374720    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374723    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374725    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374728    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374731    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374733    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374736    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374738    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374741    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374745    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374748    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374750    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374753    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374756    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374758    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374761    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:26:00.384085 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374763    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374766    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374769    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374771    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374774    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374776    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374778    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374781    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374786    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374789    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374791    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374794    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374797    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374799    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374802    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374805    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374807    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374809    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374812    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374814    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:26:00.384547 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374817    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374820    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374822    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374825    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374827    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374831    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374833    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374836    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374838    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374841    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374843    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374846    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374848    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374851    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374853    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374856    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374858    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374860    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374864    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:26:00.385067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374866    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374870    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374873    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374876    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374878    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374881    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374883    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374886    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374888    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374891    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374894    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374896    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374899    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374901    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374904    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374906    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374909    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374926    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374938    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:26:00.385521 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374941    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374944    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374947    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374949    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374952    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374955    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374957    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374961    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374965    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374968    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374970    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374974    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374979    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374982    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374987    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374990    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374993    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374995    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.374998    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:26:00.386094 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375001    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375003    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375006    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375009    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375011    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375014    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:00.375016    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.375069    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.377277    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.378225    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.378324    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.378358    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.380707    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:26:00.386636 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.381771    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:26:00.394277 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.394261    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:26:00.398024 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.398011    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 20:26:00.398850 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.398829    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:26:00.401371 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.401346    2577 fs.go:135] Filesystem UUIDs: map[360de9a3-37eb-4ba1-bf4e-6af398c462cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f72330eb-5d5e-47fc-91f2-3389f35b10dd:/dev/nvme0n1p4]
Oct 30 20:26:00.401450 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.401369    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:26:00.406701 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.406589    2577 manager.go:217] Machine: {Timestamp:2026-10-30 20:26:00.405323444 +0000 UTC m=+0.347071744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087812 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec219f3c11d87b699949611d4b292ad5 SystemUUID:ec219f3c-11d8-7b69-9949-611d4b292ad5 BootID:edc6e22e-f8cb-424a-a9c9-2fae1b7a5699 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:24:eb:9b:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:24:eb:9b:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:77:7c:01:44:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:26:00.407281 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.407268    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:26:00.407401 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.407386    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:26:00.409210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409189    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:26:00.409338 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409212    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-188.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:26:00.409387 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409340    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:26:00.409387 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409348    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:26:00.409387 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409384    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:26:00.409463 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.409401    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:26:00.410624 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.410614    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:26:00.415622 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.415610    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:26:00.415734 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.415725    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:26:00.416569 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416559    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:26:00.416605 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416575    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:26:00.416605 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416587    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:26:00.416605 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416595    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:26:00.416709 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416611    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:26:00.417005 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.416993    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:26:00.425292 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.425275    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:26:00.431666 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.431653    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:26:00.432595 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432583    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:26:00.432641 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432612    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:26:00.432757 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432745    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:26:00.432792 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432761    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:26:00.432792 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432767    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:26:00.432792 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432772    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:26:00.432792 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432778    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:26:00.432792 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.432784    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:26:00.433463 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433455    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:26:00.433463 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433464    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:26:00.433520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433472    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:26:00.433520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433478    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:26:00.433520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433487    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:26:00.433520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.433502    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:26:00.434203 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.434193    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:26:00.434203 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.434202    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:26:00.438104 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.438081    2577 server.go:1263] "Started kubelet"
Oct 30 20:26:00.438196 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.438117    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:26:00.438265 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.438190    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:26:00.438265 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.438246    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:26:00.438865 ip-10-0-135-188 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:26:00.439811 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.439795    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:26:00.441595 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.441579    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:26:00.444383 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.444351    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:26:00.448627 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.448609    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:26:00.448711 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.448630    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:26:00.448846 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.448820    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:00.449355 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449338    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:26:00.449443 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449359    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:26:00.449443 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449375    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:26:00.449553 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449494    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:26:00.449553 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449506    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:26:00.449629 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449613    2577 factory.go:55] Registering systemd factory
Oct 30 20:26:00.449629 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449628    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:26:00.449885 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449867    2577 factory.go:153] Registering CRI-O factory
Oct 30 20:26:00.449885 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.449885    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:26:00.450049 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.450025    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:26:00.450118 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.450050    2577 factory.go:103] Registering Raw factory
Oct 30 20:26:00.450118 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.450065    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:26:00.451162 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.451145    2577 manager.go:319] Starting recovery of all containers
Oct 30 20:26:00.462127 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.462111    2577 manager.go:324] Recovery completed
Oct 30 20:26:00.467476 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.467462    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.468974 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.468959    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.469032 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.468988    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.469032 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.469001    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.469453 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.469440    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:26:00.469453 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.469450    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.469549 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.469452    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:26:00.469549 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.469532    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:26:00.470088 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.470075    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.470141 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.470100    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.470141 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.470109    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.471653 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.471639    2577 policy_none.go:50] "Start"
Oct 30 20:26:00.471718 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.471657    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:26:00.471718 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.471670    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:26:00.473799 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.473787    2577 policy_none.go:44] "Start"
Oct 30 20:26:00.516445 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.516421    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:26:00.518849 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.518838    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:26:00.518898 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.518862    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:26:00.518898 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.518870    2577 server.go:87] "Starting device plugin registration server"
Oct 30 20:26:00.519114 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.519102    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:26:00.519162 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.519139    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:26:00.519243 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.519228    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:26:00.519342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.519317    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:26:00.519342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.519331    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:26:00.519761 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.519744    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:26:00.519829 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.519784    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:00.574653 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.574506    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-188.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:26:00.574653 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.574516    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-188.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:26:00.576557 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.574524    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-188.us-west-1.compute.internal.18e3687c78f1bef0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-188.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-188.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:26:00.43793176 +0000 UTC m=+0.379680060,LastTimestamp:2026-10-30 20:26:00.43793176 +0000 UTC m=+0.379680060,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-188.us-west-1.compute.internal,}"
Oct 30 20:26:00.591250 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.591226    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:26:00.592545 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.592523    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:26:00.592624 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.592548    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:26:00.592624 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.592566    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:26:00.592624 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.592596    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 20:26:00.619474 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.619455    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.620223 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.620209    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.620281 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.620240    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.620281 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.620250    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.620281 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.620271    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.629478 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.629413    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-188.us-west-1.compute.internal.18e3687c7acb67da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-188.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-188.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-188.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:26:00.46897353 +0000 UTC m=+0.410721830,LastTimestamp:2026-10-30 20:26:00.46897353 +0000 UTC m=+0.410721830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-188.us-west-1.compute.internal,}"
Oct 30 20:26:00.629761 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.629740    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 20:26:00.629807 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.629758    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-188.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 20:26:00.652807 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.652783    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:26:00.652888 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.652852    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzpdm"
Oct 30 20:26:00.693179 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.693152    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"]
Oct 30 20:26:00.693268 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.693208    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.693985 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.693971    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.694077 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.694001    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.694077 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.694016    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.696154 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696139    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.696315 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.696363 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696331    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.696862 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696848    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.696862 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696856    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.696980 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696878    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.696980 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696882    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.696980 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696893    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.697066 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.696892    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.699083 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.699068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.699149 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.699092    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:26:00.699771 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.699756    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:26:00.699828 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.699781    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:26:00.699828 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.699795    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:26:00.717220 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.717204    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.719195 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.719180    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.750789 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.750770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.750866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.750792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.750866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.750809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.827468 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.827443    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:00.829308 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.829291    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:00.829836 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.829821    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.829890 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.829846    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-188.us-west-1.compute.internal\": node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:00.851589 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.851632 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.851632 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.851695 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.851695 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851658    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.851695 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:00.851673    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:00.953576 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:00.953538    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.019996 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.019980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:01.022126 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.022112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:01.053641 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.053623    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.153795 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.153735    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.254679 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.254639    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.354881 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.354861    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.378048 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.378026    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:26:01.378474 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.378152    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a387d27a2dc53463097c2534c2d2347e-212d01575edb5520.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-188.us-west-1.compute.internal.18e3687c7acbe2d5\": read tcp 10.0.135.188:54512->18.116.137.94:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-188.us-west-1.compute.internal.18e3687c7acbe2d5  default   5129 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-188.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-188.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-188.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:26:00 +0000 UTC,LastTimestamp:2026-10-30 20:26:00.620253232 +0000 UTC m=+0.562001533,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-188.us-west-1.compute.internal,}"
Oct 30 20:26:01.378474 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.378208    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:26:01.378474 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.378210    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:26:01.455699 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.455676    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.556275 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.556221    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.656580 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:01.656554    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:26:01.657682 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.657647    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:21:00 +0000 UTC" deadline="2028-05-27 14:35:02.184419399 +0000 UTC"
Oct 30 20:26:01.657733 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.657684    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13794h9m0.52673934s"
Oct 30 20:26:01.739182 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.739155    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:01.749352 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.749326    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:01.782148 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.782125    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:01.809992 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.809938    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:26:01.810988 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.810971    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:26:01.867336 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:01.867316    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:26:02.081346 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.081312    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee272d910da8698a9f404977ca9d2f88.slice/crio-b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4 WatchSource:0}: Error finding container b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4: Status 404 returned error can't find the container with id b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4
Oct 30 20:26:02.087515 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.087499    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:26:02.132311 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.132291    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d696aa218dabae4ecafea3cbd5237b.slice/crio-a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b WatchSource:0}: Error finding container a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b: Status 404 returned error can't find the container with id a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b
Oct 30 20:26:02.346167 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.346112    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:02.417556 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.417536    2577 apiserver.go:52] "Watching apiserver"
Oct 30 20:26:02.449716 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.449690    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:26:02.575470 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.575443    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:26:02.575774 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.575756    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-r7pfv","openshift-ovn-kubernetes/ovnkube-node-vgqxd","kube-system/global-pull-secret-syncer-tn2wd","openshift-dns/node-resolver-dnm5p","openshift-multus/multus-additional-cni-plugins-ztzdn","openshift-network-diagnostics/network-check-target-b59b5","kube-system/konnectivity-agent-mkf8g","kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal","openshift-image-registry/node-ca-s76jv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal","openshift-multus/multus-bcdjh","openshift-cluster-node-tuning-operator/tuned-gnlbf","openshift-multus/network-metrics-daemon-s48cm"]
Oct 30 20:26:02.578665 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.578649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.580869 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.580848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.583128 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.583110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.583215 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.583191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:02.585405 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.585382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.587735 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.587717    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.589874 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.589856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:02.589971 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.589914    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:02.592247 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.592230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.594599 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.594582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.598500 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.597120    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.599702 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.599684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.602056 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.602037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.602140 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.602108    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:02.604516 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.604490    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.607569 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.607531    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerStarted","Data":"a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b"}
Oct 30 20:26:02.607653 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.607596    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"ee272d910da8698a9f404977ca9d2f88","Type":"ContainerStarted","Data":"b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4"}
Oct 30 20:26:02.629223 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.629207    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:26:02.637558 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.637535    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:26:02.637671 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.637597    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-52gtb\""
Oct 30 20:26:02.637733 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.637670    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmclr\""
Oct 30 20:26:02.637787 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.637736    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:26:02.638112 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.638084    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.638186 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.638120    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.644437 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.644416    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wdmm\""
Oct 30 20:26:02.650355 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.650336    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:26:02.656563 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.656545    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.656658 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.656566    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.656658 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.656568    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.659051 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.659036    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:26:02.659120 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.659113    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:26:02.659171 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.659158    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:26:02.659607 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.659594    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47trg\""
Oct 30 20:26:02.659641 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.659610    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:26:02.660045 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.660032    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fngvs\""
Oct 30 20:26:02.661130 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.661177 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661177 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661177 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661299 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661299 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661299 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661438 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.661438 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.661438 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661582 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.661582 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdl7j\" (UniqueName: \"kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.661582 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661685    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:26:02.661730 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9pxd\" (UniqueName: \"kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.661971 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.661998    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662059    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvr6\" (UniqueName: \"kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7ch\" (UniqueName: \"kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662273    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:26:02.662296 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662319    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662327    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662327    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662346    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6dtn\" (UniqueName: \"kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662552    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tppgj\" (UniqueName: \"kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.662790 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjfgg\" (UniqueName: \"kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcshw\" (UniqueName: \"kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.662989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psn57\" (UniqueName: \"kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.663353 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.663798 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.663275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.683573 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683554    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.683686 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683581    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:26:02.683686 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683584    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.683686 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683646    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:26:02.683816 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683711    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:26:02.683816 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.683723    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:26:02.686536 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.686520    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ld6lr\""
Oct 30 20:26:02.686593 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.686541    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bx2zg\""
Oct 30 20:26:02.686639 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.686613    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wczr5\""
Oct 30 20:26:02.689585 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.689572    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.689691 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.689679    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:26:02.690718 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.690704    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-cnj9l\""
Oct 30 20:26:02.690718 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.690708    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:26:02.690841 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.690745    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-56spx"
Oct 30 20:26:02.690841 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.690749    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:26:02.763880 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.763856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.763991 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.763886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.763991 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.763904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.763991 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.763920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.763991 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.763962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdl7j\" (UniqueName: \"kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.764078    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764189    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.764210 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764204    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764252    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.764265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:03.264244257 +0000 UTC m=+3.205992553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764288    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764273    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764328    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9pxd\" (UniqueName: \"kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.764567 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764543    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764570    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvr6\" (UniqueName: \"kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764614    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.764624    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764660    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764546    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.764698    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:03.264673891 +0000 UTC m=+3.206422187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764724    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764750    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.765404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.764983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7ch\" (UniqueName: \"kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dtn\" (UniqueName: \"kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.766264 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765389    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765448    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765450    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765471    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765494    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765500    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765528    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765556    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765568    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765594    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765641    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765686    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.767388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tppgj\" (UniqueName: \"kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765898    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765942    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.765987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766019    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766044    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766048    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766207    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766313    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.768342 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjfgg\" (UniqueName: \"kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766367    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcshw\" (UniqueName: \"kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn57\" (UniqueName: \"kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766446    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766538    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766653    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766767    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766801    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766854    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766911    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766931    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766970    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767053    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767111    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.766927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.769561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767170    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767234    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767316    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767352    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767371    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767561    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767720    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767797    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.767963    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.768475    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.770097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.768643    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.770602 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.768965    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.770602 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.769006    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.770602 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.769645    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.829633 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.829607    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvr6\" (UniqueName: \"kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.832348 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.832331    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:02.832427 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.832351    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:02.832427 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.832364    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:02.832427 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:02.832412    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:03.3324002 +0000 UTC m=+3.274148509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:02.835654 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.835627    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psn57\" (UniqueName: \"kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.835771 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.835678    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dtn\" (UniqueName: \"kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.835771 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.835688    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjfgg\" (UniqueName: \"kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.836449 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.836419    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9pxd\" (UniqueName: \"kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:02.836449 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.836438    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tppgj\" (UniqueName: \"kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.836585 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.836444    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdl7j\" (UniqueName: \"kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.836726 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.836708    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcshw\" (UniqueName: \"kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.837053 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.837035    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7ch\" (UniqueName: \"kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.891037 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.891009    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:02.896388 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.896373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:26:02.901166 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.901145    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a2d959_f0ce_422a_8132_74000b5383a0.slice/crio-ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e WatchSource:0}: Error finding container ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e: Status 404 returned error can't find the container with id ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e
Oct 30 20:26:02.905090 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.905052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:26:02.905504 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.905481    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb125b89e_655d_488e_a4c5_96d870660ccb.slice/crio-bfdbf22e811eceee3b0c419d0eefe7af06788165041b5c10bf173b7df10af235 WatchSource:0}: Error finding container bfdbf22e811eceee3b0c419d0eefe7af06788165041b5c10bf173b7df10af235: Status 404 returned error can't find the container with id bfdbf22e811eceee3b0c419d0eefe7af06788165041b5c10bf173b7df10af235
Oct 30 20:26:02.915067 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.915044    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce3e873_bfb3_4ae8_a487_6875c50aedc1.slice/crio-c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4 WatchSource:0}: Error finding container c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4: Status 404 returned error can't find the container with id c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4
Oct 30 20:26:02.923393 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.923379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:26:02.925593 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.925578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:26:02.930375 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.930360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:26:02.932796 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.932775    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658c1529_f42f_4f3d_9798_cff3600c2772.slice/crio-f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c WatchSource:0}: Error finding container f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c: Status 404 returned error can't find the container with id f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c
Oct 30 20:26:02.938845 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.937957    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7f593f_c940_495e_8c54_bd999ee243d8.slice/crio-cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e WatchSource:0}: Error finding container cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e: Status 404 returned error can't find the container with id cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e
Oct 30 20:26:02.942042 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.941975    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c19a307_d372_4008_abfa_de10f66837c1.slice/crio-7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0 WatchSource:0}: Error finding container 7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0: Status 404 returned error can't find the container with id 7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0
Oct 30 20:26:02.946783 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.946764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bcdjh"
Oct 30 20:26:02.951641 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.951624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:26:02.955616 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:02.955577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:02.955883 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.955863    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444c4868_604d_4d77_8686_d42468026f4a.slice/crio-90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583 WatchSource:0}: Error finding container 90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583: Status 404 returned error can't find the container with id 90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583
Oct 30 20:26:02.961776 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.961758    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603efcb0_0cdc_447b_892a_fc99c798030a.slice/crio-8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af WatchSource:0}: Error finding container 8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af: Status 404 returned error can't find the container with id 8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af
Oct 30 20:26:02.964711 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:02.964689    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e51ac73_92e8_48e1_a0ef_5ba865824e80.slice/crio-a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612 WatchSource:0}: Error finding container a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612: Status 404 returned error can't find the container with id a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612
Oct 30 20:26:03.271119 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.271031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:03.271119 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.271079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:03.271324 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.271218    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:03.271324 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.271269    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:04.271254827 +0000 UTC m=+4.213003130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:03.271426 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.271330    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:03.271426 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.271357    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:04.271347195 +0000 UTC m=+4.213095498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:03.372124 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.372087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:03.372323 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.372271    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:03.372323 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.372286    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:03.372323 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.372296    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:03.372449 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:03.372336    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:04.372324004 +0000 UTC m=+4.314072296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:03.601974 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.601893    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bcdjh" event={"ID":"444c4868-604d-4d77-8686-d42468026f4a","Type":"ContainerStarted","Data":"90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583"}
Oct 30 20:26:03.603349 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.603318    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerStarted","Data":"7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0"}
Oct 30 20:26:03.604796 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.604768    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnm5p" event={"ID":"1ce3e873-bfb3-4ae8-a487-6875c50aedc1","Type":"ContainerStarted","Data":"c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4"}
Oct 30 20:26:03.606182 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.606158    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612"}
Oct 30 20:26:03.607445 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.607423    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc" event={"ID":"603efcb0-0cdc-447b-892a-fc99c798030a","Type":"ContainerStarted","Data":"8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af"}
Oct 30 20:26:03.608939 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.608902    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7pfv" event={"ID":"2e7f593f-c940-495e-8c54-bd999ee243d8","Type":"ContainerStarted","Data":"cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e"}
Oct 30 20:26:03.610254 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.610224    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s76jv" event={"ID":"658c1529-f42f-4f3d-9798-cff3600c2772","Type":"ContainerStarted","Data":"f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c"}
Oct 30 20:26:03.611719 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.611698    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gnlbf" event={"ID":"b125b89e-655d-488e-a4c5-96d870660ccb","Type":"ContainerStarted","Data":"bfdbf22e811eceee3b0c419d0eefe7af06788165041b5c10bf173b7df10af235"}
Oct 30 20:26:03.612958 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.612934    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkf8g" event={"ID":"03a2d959-f0ce-422a-8132-74000b5383a0","Type":"ContainerStarted","Data":"ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e"}
Oct 30 20:26:03.694096 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.694043    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:21:02 +0000 UTC" deadline="2028-07-07 01:56:46.238069054 +0000 UTC"
Oct 30 20:26:03.694096 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:03.694082    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14765h30m42.543991798s"
Oct 30 20:26:04.280557 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.280520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:04.280713 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.280580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:04.280771 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.280738    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:04.280842 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.280798    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:06.280780302 +0000 UTC m=+6.222528603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:04.280904 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.280863    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:04.280904 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.280894    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:06.280883657 +0000 UTC m=+6.222631946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:04.381666 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.381628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:04.381847 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.381799    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:04.381847 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.381825    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:04.381847 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.381838    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:04.382026 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.381897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:06.381879986 +0000 UTC m=+6.323628293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:04.595073 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.595040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:04.595217 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.595193    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:04.595304 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.595289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:04.595395 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.595378    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:04.596812 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.596788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:04.596952 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:04.596893    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:04.694497 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.694353    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:21:02 +0000 UTC" deadline="2028-07-02 11:11:54.397842426 +0000 UTC"
Oct 30 20:26:04.694497 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:04.694424    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14654h45m49.703422739s"
Oct 30 20:26:05.643334 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:05.643085    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"ee272d910da8698a9f404977ca9d2f88","Type":"ContainerStarted","Data":"8528a3dc550c1f4211a7ad3fcb0d700b5704fdcf6dfb0c92db66cb5ad2e33d83"}
Oct 30 20:26:05.646762 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:05.646216    2577 generic.go:356] "Generic (PLEG): container finished" podID="d6d696aa218dabae4ecafea3cbd5237b" containerID="43fe533aa3e0460d97a403c917b55ab5cb3667a99891a579763322ee128e0c25" exitCode=0
Oct 30 20:26:05.646762 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:05.646254    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerDied","Data":"43fe533aa3e0460d97a403c917b55ab5cb3667a99891a579763322ee128e0c25"}
Oct 30 20:26:05.875887 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:05.874886    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal" podStartSLOduration=4.87486637 podStartE2EDuration="4.87486637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:05.759722042 +0000 UTC m=+5.701470352" watchObservedRunningTime="2026-10-30 20:26:05.87486637 +0000 UTC m=+5.816614679"
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.304250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.304324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.304478    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.304541    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:10.304523067 +0000 UTC m=+10.246271387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.304609    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:06.304691 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.304644    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:10.304633245 +0000 UTC m=+10.246381549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:06.405638 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.405343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:06.405638 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.405514    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:06.405638 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.405532    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:06.405638 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.405545    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:06.405638 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.405601    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:10.405584315 +0000 UTC m=+10.347332617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:06.595376 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.595295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:06.595533 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.595438    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:06.595533 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.595518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:06.595649 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.595596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:06.595699 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.595667    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:06.595749 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:06.595734    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:06.652360 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.652315    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerStarted","Data":"d825ec9583eb59bf45d853c35a430f3544141f21ad8b7a2df69f901ff91dd215"}
Oct 30 20:26:06.655438 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.655410    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="e558152c3ad0891bfdc5f72a99e45593903be6d4c9cf28589f898c21b3946b10" exitCode=0
Oct 30 20:26:06.656126 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.656105    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"e558152c3ad0891bfdc5f72a99e45593903be6d4c9cf28589f898c21b3946b10"}
Oct 30 20:26:06.905574 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:06.905515    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" podStartSLOduration=5.9054921369999995 podStartE2EDuration="5.905492137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:06.779604365 +0000 UTC m=+6.721352679" watchObservedRunningTime="2026-10-30 20:26:06.905492137 +0000 UTC m=+6.847240447"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.594673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:08.594815    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.594926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:08.595006    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.595083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:08.595291 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:08.595165    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:08.680244 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.679574    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s76jv" event={"ID":"658c1529-f42f-4f3d-9798-cff3600c2772","Type":"ContainerStarted","Data":"94fc8ebd4a3a106cba8e2385bfae74d0123b6c2ff952005abb4978e96691d24f"}
Oct 30 20:26:08.684682 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.684268    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkf8g" event={"ID":"03a2d959-f0ce-422a-8132-74000b5383a0","Type":"ContainerStarted","Data":"b244abeee4db1c91ecd275013bae624abdc37fab9ef6ddac7ffed6c811ea6272"}
Oct 30 20:26:08.794092 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.793262    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s76jv" podStartSLOduration=3.609682327 podStartE2EDuration="8.793243417s" totalImagesPullingTime="5.18356109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:08.793133584 +0000 UTC m=+8.734881883" watchObservedRunningTime="2026-10-30 20:26:08.793243417 +0000 UTC m=+8.734991727"
Oct 30 20:26:08.907205 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:08.907142    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mkf8g" podStartSLOduration=4.205676195 podStartE2EDuration="8.907120531s" totalImagesPullingTime="4.701444336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:08.906167299 +0000 UTC m=+8.847915628" watchObservedRunningTime="2026-10-30 20:26:08.907120531 +0000 UTC m=+8.848868841"
Oct 30 20:26:09.690169 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:09.690016    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc" event={"ID":"603efcb0-0cdc-447b-892a-fc99c798030a","Type":"ContainerStarted","Data":"f7f9797c0c933b27752c4155714a173b50a414ec75fc6f5441ccae1e84c27b17"}
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.343116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.343227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.343374    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.343440    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:18.343421051 +0000 UTC m=+18.285169343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.343513    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:10.343594 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.343549    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:18.343538011 +0000 UTC m=+18.285286319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:10.444108 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.443789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:10.444108 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.443966    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:10.444108 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.443982    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:10.444108 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.443991    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:10.444108 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.444035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:18.444023398 +0000 UTC m=+18.385771697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.594598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.594720    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.594768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.594830    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:10.594866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:10.595020 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:10.594946    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:11.574938 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.574730    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:26:11.698283 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.698172    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bcdjh" event={"ID":"444c4868-604d-4d77-8686-d42468026f4a","Type":"ContainerStarted","Data":"6a1924cbe02476189173faaebaf4f413e5982c9ea0ffd8bec10d1def7e0e50c8"}
Oct 30 20:26:11.701337 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.701314    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerStarted","Data":"62d608d0e1d02447afc2a6184dcc792c894a3c38a2d947128e7f39e44a0dcff0"}
Oct 30 20:26:11.703371 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.703343    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnm5p" event={"ID":"1ce3e873-bfb3-4ae8-a487-6875c50aedc1","Type":"ContainerStarted","Data":"62113522db4e4b3ec6018424da3a133fbee1bbea2868d2ece2700c72a7a65e18"}
Oct 30 20:26:11.706384 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.706346    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc" event={"ID":"603efcb0-0cdc-447b-892a-fc99c798030a","Type":"ContainerStarted","Data":"4a66ca81a317541c80f4cbb2a497d3a2bf554b8d738dfd64fa6d70957dd70144"}
Oct 30 20:26:11.816183 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.816095    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bcdjh" podStartSLOduration=3.802917398 podStartE2EDuration="11.81607907s" totalImagesPullingTime="8.013161672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:11.815464384 +0000 UTC m=+11.757212693" watchObservedRunningTime="2026-10-30 20:26:11.81607907 +0000 UTC m=+11.757827378"
Oct 30 20:26:11.933048 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:11.932995    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnm5p" podStartSLOduration=3.751413665 podStartE2EDuration="11.932981483s" totalImagesPullingTime="8.181567818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:11.932475208 +0000 UTC m=+11.874223517" watchObservedRunningTime="2026-10-30 20:26:11.932981483 +0000 UTC m=+11.874729791"
Oct 30 20:26:12.525188 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.525082    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:26:11.574752924Z","UUID":"c5e3917a-6d97-454c-823a-1fcd48f533a6","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:26:12.526763 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.526739    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:26:12.526883 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.526771    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:26:12.595653 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.595614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:12.596031 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:12.595735    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:12.596031 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.595804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:12.596031 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:12.595869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:12.596031 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.595948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:12.596031 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:12.596013    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:12.712760 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.712685    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="62d608d0e1d02447afc2a6184dcc792c894a3c38a2d947128e7f39e44a0dcff0" exitCode=0
Oct 30 20:26:12.713663 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.713638    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"62d608d0e1d02447afc2a6184dcc792c894a3c38a2d947128e7f39e44a0dcff0"}
Oct 30 20:26:12.875508 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.874615    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:12.875508 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:12.875269    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:13.717375 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:13.717171    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7pfv" event={"ID":"2e7f593f-c940-495e-8c54-bd999ee243d8","Type":"ContainerStarted","Data":"b83c1fc282fcdfd26079f7f7d3bf097a02b12432f50b4391fc626b6f830324fc"}
Oct 30 20:26:13.831103 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:13.831054    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r7pfv" podStartSLOduration=5.307041713 podStartE2EDuration="13.831036373s" totalImagesPullingTime="8.52399466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:13.830385448 +0000 UTC m=+13.772133761" watchObservedRunningTime="2026-10-30 20:26:13.831036373 +0000 UTC m=+13.772784682"
Oct 30 20:26:14.593511 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.593480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:14.593511 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.593482    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:14.593734 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.593643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:14.593734 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:14.593647    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:14.593842 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:14.593733    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:14.593842 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:14.593782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:14.720380 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.720340    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc" event={"ID":"603efcb0-0cdc-447b-892a-fc99c798030a","Type":"ContainerStarted","Data":"500b78aab19deea2cc4f84e0cd66794868c85b757e779c76dd3ddb72e9fba6e8"}
Oct 30 20:26:14.722156 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.722133    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gnlbf" event={"ID":"b125b89e-655d-488e-a4c5-96d870660ccb","Type":"ContainerStarted","Data":"1887d41af40e4370014daa4995154486c7da6d5af06936ac713d3c4da024ff8e"}
Oct 30 20:26:14.724604 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.724577    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="9847dde0cfe3ac68a7da6ed6951d5f7c12c2fbe20d3e946813d2e17a2f8e7eac" exitCode=0
Oct 30 20:26:14.724731 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.724617    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"9847dde0cfe3ac68a7da6ed6951d5f7c12c2fbe20d3e946813d2e17a2f8e7eac"}
Oct 30 20:26:14.838011 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.837963    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc" podStartSLOduration=4.444779252 podStartE2EDuration="14.83794863s" totalImagesPullingTime="10.393169378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:14.837127721 +0000 UTC m=+14.778876034" watchObservedRunningTime="2026-10-30 20:26:14.83794863 +0000 UTC m=+14.779696939"
Oct 30 20:26:14.954390 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:14.954331    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gnlbf" podStartSLOduration=4.146503084 podStartE2EDuration="14.954317413s" totalImagesPullingTime="10.807814329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:14.953843264 +0000 UTC m=+14.895591570" watchObservedRunningTime="2026-10-30 20:26:14.954317413 +0000 UTC m=+14.896065723"
Oct 30 20:26:16.593632 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:16.593599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:16.593632 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:16.593608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:16.594426 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:16.593669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:16.594426 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:16.593772    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:16.594426 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:16.593840    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:16.594426 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:16.593962    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:16.731143 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:16.731116    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="b390584b4f8c511059f8715c74582331b4604d6a43d2ca99e50f0dcf30d9119e" exitCode=0
Oct 30 20:26:16.731291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:16.731159    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"b390584b4f8c511059f8715c74582331b4604d6a43d2ca99e50f0dcf30d9119e"}
Oct 30 20:26:18.411893 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.411695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:18.412384 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.411841    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:18.412384 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.411932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:18.412384 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.411991    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:34.411972017 +0000 UTC m=+34.353720313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:18.412384 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.412032    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:18.412384 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.412094    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:26:34.412078147 +0000 UTC m=+34.353826455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:18.512444 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.512416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:18.512606 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.512587    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:18.512651 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.512615    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:18.512651 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.512628    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:18.512778 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.512682    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:26:34.512665309 +0000 UTC m=+34.454413607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:18.593610 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.593374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:18.593711 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.593388    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:18.593760 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.593418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:18.593838 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.593816    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:18.593961 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.593942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:18.594038 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:18.594021    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:18.738294 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.738261    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerStarted","Data":"55aa3697303822931dcac7a02def2402cd1e2e046e07b3122ae83344d6cb0ca2"}
Oct 30 20:26:18.741405 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741380    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"18cf4573271bad934e6035236b7d8304548d0f58996acd52a1edc971d48bf019"}
Oct 30 20:26:18.741575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741435    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"f4e152d4391704adf9510c9e0026c3ba2873ffcfb861b070004c674878516add"}
Oct 30 20:26:18.741575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741466    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"c935ae96efeb58976c2532f25d9454811a9b90aaeaf6faa72f24c31be5c2183a"}
Oct 30 20:26:18.741575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741493    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"63ce60ef2f75f568029d29555f4fefdbcb0c1d6d2243b39c419c69a615c0882c"}
Oct 30 20:26:18.741575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741521    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"91fec99ef4cb2b610be5e5a4272064340993eb699919432244dd57e6c2901977"}
Oct 30 20:26:18.741575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:18.741549    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"15886bd233a532a0215125f47b2d830317a6f949fd2251ccead8732ca98f894c"}
Oct 30 20:26:19.746136 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:19.746109    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="55aa3697303822931dcac7a02def2402cd1e2e046e07b3122ae83344d6cb0ca2" exitCode=0
Oct 30 20:26:19.746543 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:19.746153    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"55aa3697303822931dcac7a02def2402cd1e2e046e07b3122ae83344d6cb0ca2"}
Oct 30 20:26:19.918279 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:19.918256    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:19.918406 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:19.918395    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:26:19.918901 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:19.918879    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:26:20.594141 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.594071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:20.594285 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:20.594140    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:20.594285 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.594242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:20.594395 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:20.594346    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:20.594443 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.594398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:20.594487 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:20.594464    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:20.750570 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.750537    2577 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="8de0983e025ebf7793e486d9ace7149b34872bd98916d0cc516d98f591d7e231" exitCode=0
Oct 30 20:26:20.751074 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.750624    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerDied","Data":"8de0983e025ebf7793e486d9ace7149b34872bd98916d0cc516d98f591d7e231"}
Oct 30 20:26:20.754129 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:20.754111    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"2d619ffbca2a78a460f4c8f763615c404b9b5a0cfce53c591cbbc76e72f13e99"}
Oct 30 20:26:21.759771 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:21.759730    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" event={"ID":"4c19a307-d372-4008-abfa-de10f66837c1","Type":"ContainerStarted","Data":"05d5b8a8b5637daa40881ceaa51ea4f037f765077a3cbc770b9cda46f15209b4"}
Oct 30 20:26:21.981095 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:21.981048    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ztzdn" podStartSLOduration=9.587776515 podStartE2EDuration="21.981035548s" totalImagesPullingTime="12.393259033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:21.931416957 +0000 UTC m=+21.873165269" watchObservedRunningTime="2026-10-30 20:26:21.981035548 +0000 UTC m=+21.922783857"
Oct 30 20:26:22.593800 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:22.593728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:22.593800 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:22.593784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:22.593996 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:22.593892    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:22.593996 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:22.593973    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:22.593996 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:22.593994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:22.594099 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:22.594060    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:22.765370 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:22.765334    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" event={"ID":"3e51ac73-92e8-48e1-a0ef-5ba865824e80","Type":"ContainerStarted","Data":"22b85b7b29ae6b2e40ddd9dcfb51a369d873556863a660df5ec14b0c0fea06a9"}
Oct 30 20:26:22.968705 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:22.968660    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd" podStartSLOduration=8.077911513 podStartE2EDuration="22.968647844s" totalImagesPullingTime="14.890736331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:22.968305542 +0000 UTC m=+22.910053853" watchObservedRunningTime="2026-10-30 20:26:22.968647844 +0000 UTC m=+22.910396153"
Oct 30 20:26:23.767998 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:23.767969    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:23.768518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:23.768060    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:23.768518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:23.768117    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:23.782781 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:23.782760    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:23.783054 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:23.783036    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:24.593109 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:24.592870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:24.593279 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:24.592898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:24.593279 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:24.593184    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:24.593381 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:24.592966    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:24.593381 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:24.593307    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:24.593381 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:24.593370    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:25.089723 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.089689    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn2wd"]
Oct 30 20:26:25.090182 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.089807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:25.090182 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:25.089945    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:25.090475 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.090446    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b59b5"]
Oct 30 20:26:25.090572 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.090523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:25.090627 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:25.090610    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:25.091583 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.091565    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s48cm"]
Oct 30 20:26:25.091649 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:25.091637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:25.091751 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:25.091732    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:26.592950 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:26.592897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:26.593410 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:26.592897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:26.593410 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:26.593062    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:26.593410 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:26.592900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:26.593410 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:26.593102    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:26.593410 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:26.593199    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:28.598717 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:28.598685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:28.599214 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:28.598807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:28.599214 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:28.598814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:28.599214 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:28.598815    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:28.599214 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:28.598906    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:28.599214 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:28.598989    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:29.650176 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:29.650152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnm5p_1ce3e873-bfb3-4ae8-a487-6875c50aedc1/dns-node-resolver/0.log"
Oct 30 20:26:30.487836 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:30.487809    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s76jv_658c1529-f42f-4f3d-9798-cff3600c2772/node-ca/0.log"
Oct 30 20:26:30.594132 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:30.594108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:30.594250 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:30.594222    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:30.594339 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:30.594322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:30.594470 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:30.594441    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:30.594520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:30.594468    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:30.594557 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:30.594531    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:32.593370 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:32.593329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:32.593370 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:32.593329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:32.593883 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:32.593540    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:32.593883 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:32.593557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:32.593883 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:32.593636    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:32.593883 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:32.593705    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:34.432969 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.432941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:34.433241 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.433001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:34.433241 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.433078    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:34.433241 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.433139    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs podName:e4c98799-681b-46ea-8dfd-1081c6ecbd34 nodeName:}" failed. No retries permitted until 2026-10-30 20:27:06.433124462 +0000 UTC m=+66.374872807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs") pod "network-metrics-daemon-s48cm" (UID: "e4c98799-681b-46ea-8dfd-1081c6ecbd34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:26:34.433241 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.433083    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:34.433241 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.433211    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret podName:c6215d32-ffbd-4fbf-a13d-3df9527fcd53 nodeName:}" failed. No retries permitted until 2026-10-30 20:27:06.433199728 +0000 UTC m=+66.374948072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret") pod "global-pull-secret-syncer-tn2wd" (UID: "c6215d32-ffbd-4fbf-a13d-3df9527fcd53") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:26:34.533542 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.533515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:34.533660 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.533617    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:26:34.533660 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.533629    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:26:34.533660 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.533638    2577 projected.go:196] Error preparing data for projected volume kube-api-access-jj7cr for pod openshift-network-diagnostics/network-check-target-b59b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:34.533763 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.533675    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr podName:58a9d910-0c75-4701-8745-01683f4ad8da nodeName:}" failed. No retries permitted until 2026-10-30 20:27:06.533664742 +0000 UTC m=+66.475413030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7cr" (UniqueName: "kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr") pod "network-check-target-b59b5" (UID: "58a9d910-0c75-4701-8745-01683f4ad8da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:26:34.593611 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.593582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:34.593611 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.593591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:34.593611 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:34.593603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:34.593831 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.593682    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:34.593831 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.593738    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:34.593831 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:34.593798    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:36.593540 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:36.593502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:36.593540 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:36.593531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:36.594057 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:36.593615    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:36.594057 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:36.593657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:36.594057 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:36.593718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:36.594057 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:36.593809    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:38.593562 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:38.593528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:38.594046 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:38.593641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:38.594046 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:38.593650    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:38.594046 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:38.593759    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:38.594046 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:38.593794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:38.594046 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:38.593885    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:40.593808 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:40.593777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:40.594254 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:40.593876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:40.594254 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:40.593943    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:40.594254 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:40.594029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:40.594254 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:40.594022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:40.594254 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:40.594107    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:42.593645 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:42.593618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:42.594167 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:42.593738    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:42.594167 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:42.593805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:42.594167 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:42.593897    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:42.594167 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:42.593961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:42.594167 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:42.594053    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:44.593465 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:44.593425    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:44.593465 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:44.593449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:44.594081 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:44.593437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:44.594081 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:44.593563    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:44.594081 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:44.593676    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:44.594081 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:44.593768    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:46.593033 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:46.592998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:46.593486 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:46.593040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:46.593486 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:46.592998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:46.593486 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:46.593117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s48cm" podUID="e4c98799-681b-46ea-8dfd-1081c6ecbd34"
Oct 30 20:26:46.593486 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:46.593191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59b5" podUID="58a9d910-0c75-4701-8745-01683f4ad8da"
Oct 30 20:26:46.593486 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:26:46.593259    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn2wd" podUID="c6215d32-ffbd-4fbf-a13d-3df9527fcd53"
Oct 30 20:26:47.864704 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:47.864681    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:26:47.865039 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:47.864772    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:26:48.019253 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.019187    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x8rwl"]
Oct 30 20:26:48.021039 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.021023    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xchfk"]
Oct 30 20:26:48.021157 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.021141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.022604 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.022585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.043259 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.043239    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xchfk"]
Oct 30 20:26:48.047103 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.047082    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8rwl"]
Oct 30 20:26:48.072925 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.072900    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jq2bz"]
Oct 30 20:26:48.074570 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.074550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.074994 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.074973    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:26:48.074994 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.074979    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:26:48.075139 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.075022    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:26:48.075139 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.075033    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:26:48.075139 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.075037    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:26:48.075139 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.075062    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bpqv7\""
Oct 30 20:26:48.135258 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.135232    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jq2bz"]
Oct 30 20:26:48.138600 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgtg\" (UniqueName: \"kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.138723 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.138723 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.138815 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.138815 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.138815 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zcj\" (UniqueName: \"kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.138960 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.138997 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.138997 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.138982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jvjg\" (UniqueName: \"kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.139093 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.139072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.139145 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.139111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.174886 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.174863    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:26:48.175014 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.174972    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwgrd\""
Oct 30 20:26:48.175014 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.174978    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:26:48.175014 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.174978    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-bxjhb\""
Oct 30 20:26:48.175014 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.175010    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:26:48.175152 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.175016    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:26:48.239998 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.239981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240063 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.240063 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240063 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.240063 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zcj\" (UniqueName: \"kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvjg\" (UniqueName: \"kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240249 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgtg\" (UniqueName: \"kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.240501 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240608 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240584    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.240658 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240590    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.240707 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.240669    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.241025 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.241002    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.243680 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.243657    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.243765 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.243699    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.243765 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.243752    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.298410 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.298357    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zcj\" (UniqueName: \"kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.298410 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.298386    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgtg\" (UniqueName: \"kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.298520 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.298362    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvjg\" (UniqueName: \"kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.336021 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.335998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:26:48.337866 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.337850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:26:48.385493 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.385465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:48.593404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.593338    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:26:48.593404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.593364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:26:48.593404 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.593366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:26:48.649682 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.649647    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:26:48.649787 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.649770    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:26:48.650033 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.650020    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78mnk\""
Oct 30 20:26:48.650094 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.650049    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mkv2p\""
Oct 30 20:26:48.650132 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.650103    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5tplx\""
Oct 30 20:26:48.650883 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.650868    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:26:48.650960 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.650946    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:26:48.777503 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.777469    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xchfk"]
Oct 30 20:26:48.778208 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.778182    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8rwl"]
Oct 30 20:26:48.780270 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.780248    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jq2bz"]
Oct 30 20:26:48.782628 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:48.782607    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2197b8_f824_455b_8229_555a994abbac.slice/crio-83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d WatchSource:0}: Error finding container 83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d: Status 404 returned error can't find the container with id 83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d
Oct 30 20:26:48.783227 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:48.783145    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f8c3cf_76c6_4abb_bd8f_28ab2a0fa422.slice/crio-154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67 WatchSource:0}: Error finding container 154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67: Status 404 returned error can't find the container with id 154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67
Oct 30 20:26:48.783907 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:48.783840    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dd0f77_38e1_4ff9_b1a7_f5a3421efa51.slice/crio-c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2 WatchSource:0}: Error finding container c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2: Status 404 returned error can't find the container with id c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2
Oct 30 20:26:48.816896 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.816874    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jq2bz" event={"ID":"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51","Type":"ContainerStarted","Data":"c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2"}
Oct 30 20:26:48.818065 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.818045    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8rwl" event={"ID":"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422","Type":"ContainerStarted","Data":"154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67"}
Oct 30 20:26:48.819178 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:48.819160    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xchfk" event={"ID":"af2197b8-f824-455b-8229-555a994abbac","Type":"ContainerStarted","Data":"83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d"}
Oct 30 20:26:49.825128 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:49.825080    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8rwl" event={"ID":"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422","Type":"ContainerStarted","Data":"e1374993508777aeaf7c74d1218d5e3467c1518faa91dcb8f7310687fbc9382b"}
Oct 30 20:26:50.830878 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:50.830839    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8rwl" event={"ID":"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422","Type":"ContainerStarted","Data":"e179003ae039d61ebf0caf3bf5d2e7f62167337083c7615a94a10a48e85ff034"}
Oct 30 20:26:51.836777 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:51.836728    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jq2bz" event={"ID":"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51","Type":"ContainerStarted","Data":"d0608a5a5ab5ad9e7a7d2bb0a8a16d9b6b683c6883b92eba92b44b295100b802"}
Oct 30 20:26:51.837222 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:51.836795    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jq2bz" event={"ID":"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51","Type":"ContainerStarted","Data":"e169c295aecf69c8a321a5bceb9015ce539d41189a3f4ba16471acf2207aba75"}
Oct 30 20:26:51.837222 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:51.836935    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:26:51.956110 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:51.956064    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-jq2bz" podStartSLOduration=1.82496137 podStartE2EDuration="3.956051519s" totalImagesPullingTime="2.131090149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:51.955368529 +0000 UTC m=+51.897116838" watchObservedRunningTime="2026-10-30 20:26:51.956051519 +0000 UTC m=+51.897799827"
Oct 30 20:26:52.840582 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:52.840543    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xchfk" event={"ID":"af2197b8-f824-455b-8229-555a994abbac","Type":"ContainerStarted","Data":"9109cd69472940d2609be92880ceda8ad81a33135c8123f6b5ced7a106c5f9fc"}
Oct 30 20:26:52.842760 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:52.842730    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8rwl" event={"ID":"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422","Type":"ContainerStarted","Data":"09ecd054de0b7058360f12c4373773c8260d51ff51874d51ccfc08881e6e9958"}
Oct 30 20:26:52.956784 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:52.956740    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xchfk" podStartSLOduration=2.65410523 podStartE2EDuration="5.95672336s" totalImagesPullingTime="3.30261813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:52.956050652 +0000 UTC m=+52.897798960" watchObservedRunningTime="2026-10-30 20:26:52.95672336 +0000 UTC m=+52.898471694"
Oct 30 20:26:53.074302 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:53.074252    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x8rwl" podStartSLOduration=3.054108514 podStartE2EDuration="6.074237899s" totalImagesPullingTime="3.020129385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:26:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:53.074060337 +0000 UTC m=+53.015808645" watchObservedRunningTime="2026-10-30 20:26:53.074237899 +0000 UTC m=+53.015986208"
Oct 30 20:26:54.571083 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.571050    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"]
Oct 30 20:26:54.573025 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.573004    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.675689 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.675665    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:26:54.675811 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.675746    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:26:54.677035 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.677008    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:26:54.677108 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.677022    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 20:26:54.677161 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.677145    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c8jj7\""
Oct 30 20:26:54.677161 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.677154    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 20:26:54.696380 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.696359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.696465 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.696388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.696465 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.696429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.696575 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.696558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngg4\" (UniqueName: \"kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.726180 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.726159    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"]
Oct 30 20:26:54.797024 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.797003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.797089 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.797032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngg4\" (UniqueName: \"kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.797089 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.797071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.797188 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.797089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.797690 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.797667    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.799465 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.799448    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.799544 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.799491    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.856714 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.856661    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngg4\" (UniqueName: \"kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:54.883594 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:54.883574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:26:55.250754 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:55.250726    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"]
Oct 30 20:26:55.253564 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:26:55.253540    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c50552_39f0_4be4_9d70_ffade02c476f.slice/crio-58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05 WatchSource:0}: Error finding container 58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05: Status 404 returned error can't find the container with id 58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05
Oct 30 20:26:55.782935 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:55.782893    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:26:55.850593 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:55.850563    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm" event={"ID":"39c50552-39f0-4be4-9d70-ffade02c476f","Type":"ContainerStarted","Data":"58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05"}
Oct 30 20:26:57.858886 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:57.858844    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm" event={"ID":"39c50552-39f0-4be4-9d70-ffade02c476f","Type":"ContainerStarted","Data":"e6b597be12bf405d1d2141e90956dfda22aefdb88ba3554ade01563bc3b8ad46"}
Oct 30 20:26:57.859362 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:57.858956    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm" event={"ID":"39c50552-39f0-4be4-9d70-ffade02c476f","Type":"ContainerStarted","Data":"48eb5514b31fd4cd60f653ffc77e93626a11a73a518ff86b13fedf5f47b9e074"}
Oct 30 20:26:57.975024 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:26:57.974980    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm" podStartSLOduration=2.36263522 podStartE2EDuration="3.974964148s" totalImagesPullingTime="1.612328928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:57.974369893 +0000 UTC m=+57.916118203" watchObservedRunningTime="2026-10-30 20:26:57.974964148 +0000 UTC m=+57.916712457"
Oct 30 20:27:01.225889 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.225856    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5xvsh"]
Oct 30 20:27:01.228444 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.228420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.288227 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.288198    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:27:01.334055 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.334026    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:27:01.334055 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.334026    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:27:01.334194 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.334086    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwr4g\""
Oct 30 20:27:01.340174 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340236 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340304 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340340 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-648mr\" (UniqueName: \"kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340396 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340430 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340471 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340471 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.340541 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.340516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441649 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441649 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441823 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441823 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441823 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.441823 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441849    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-648mr\" (UniqueName: \"kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441849    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442002 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.441897    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442225 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:27:01.442030    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Oct 30 20:27:01.442225 ip-10-0-135-188 kubenswrapper[2577]: E1030 20:27:01.442116    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls podName:85fec599-5ad3-4971-a4ce-15f46736d55a nodeName:}" failed. No retries permitted until 2026-10-30 20:27:01.942096079 +0000 UTC m=+61.883844383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls") pod "node-exporter-5xvsh" (UID: "85fec599-5ad3-4971-a4ce-15f46736d55a") : secret "node-exporter-tls" not found
Oct 30 20:27:01.442225 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.442120    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442351 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.442331    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.442395 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.442331    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.444390 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.444371    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.512366 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.512313    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-648mr\" (UniqueName: \"kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.845097 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.845022    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:01.945098 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.945069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:01.947544 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:01.947523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:02.139313 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:02.139287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:02.148485 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:02.148457    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fec599_5ad3_4971_a4ce_15f46736d55a.slice/crio-8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435 WatchSource:0}: Error finding container 8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435: Status 404 returned error can't find the container with id 8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435
Oct 30 20:27:02.875642 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:02.875595    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xvsh" event={"ID":"85fec599-5ad3-4971-a4ce-15f46736d55a","Type":"ContainerStarted","Data":"8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435"}
Oct 30 20:27:03.879951 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.879902    2577 generic.go:356] "Generic (PLEG): container finished" podID="85fec599-5ad3-4971-a4ce-15f46736d55a" containerID="1ea4a265448fce744beee5d3062d475f09369018174dfbb2e254619b0be73981" exitCode=0
Oct 30 20:27:03.880316 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.879969    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xvsh" event={"ID":"85fec599-5ad3-4971-a4ce-15f46736d55a","Type":"ContainerDied","Data":"1ea4a265448fce744beee5d3062d475f09369018174dfbb2e254619b0be73981"}
Oct 30 20:27:03.906202 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.906177    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-595768c758-7mcq9"]
Oct 30 20:27:03.908848 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.908834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959148 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959259 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959314 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959314 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959438 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959547 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959639 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lgl\" (UniqueName: \"kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959676 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.959712 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.959690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:03.971393 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.971299    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:27:03.971393 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.971350    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:27:03.971393 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.971299    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:27:03.971393 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.971374    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b99890thc43p4\""
Oct 30 20:27:03.991547 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:03.991524    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-595768c758-7mcq9"]
Oct 30 20:27:04.060146 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060307 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060307 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lgl\" (UniqueName: \"kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060307 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060307 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060571 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060571 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060571 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060571 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.060869 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.060849    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.061386 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.061360    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.062804 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.062787    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.062974 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.062957    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.063214 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.063196    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.063348 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.063329    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.064957 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.064937    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:27:04.065191 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.065175    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:27:04.065285 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.065273    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gvqs4\""
Oct 30 20:27:04.072716 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.072697    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.072903 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.072886    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.121597 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.121567    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lgl\" (UniqueName: \"kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.225611 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.225536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:04.647466 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.647439    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-595768c758-7mcq9"]
Oct 30 20:27:04.651044 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:04.651018    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869e6098_8b18_4a7c_baa5_f4e2db8f5a97.slice/crio-f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544 WatchSource:0}: Error finding container f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544: Status 404 returned error can't find the container with id f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544
Oct 30 20:27:04.884614 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.884579    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544"}
Oct 30 20:27:04.886848 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.886823    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xvsh" event={"ID":"85fec599-5ad3-4971-a4ce-15f46736d55a","Type":"ContainerStarted","Data":"e554a2ecdf17c68d732a605d890eb6719d0d7fb74d4c1c40e102125662c346e1"}
Oct 30 20:27:04.886983 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:04.886863    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xvsh" event={"ID":"85fec599-5ad3-4971-a4ce-15f46736d55a","Type":"ContainerStarted","Data":"3dce446afbc7277597b6602778d20a0546bb2b75daf270d36766722480e5c75d"}
Oct 30 20:27:05.010987 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.010882    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5xvsh" podStartSLOduration=2.633943436 podStartE2EDuration="4.01086787s" totalImagesPullingTime="1.301396009s" totalInitContainerRuntime="75.528425ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:05.010060251 +0000 UTC m=+64.951808560" watchObservedRunningTime="2026-10-30 20:27:05.01086787 +0000 UTC m=+64.952616173"
Oct 30 20:27:05.878068 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.878037    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"]
Oct 30 20:27:05.881757 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.881718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:05.942100 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.942063    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"]
Oct 30 20:27:05.976516 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.976489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:05.976856 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.976821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgl9v\" (UniqueName: \"kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:05.990785 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.990765    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:27:05.990785 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:05.990764    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l9s5p\""
Oct 30 20:27:06.078219 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.078184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgl9v\" (UniqueName: \"kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:06.078382 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.078260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:06.081205 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.081170    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:06.147629 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.147574    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgl9v\" (UniqueName: \"kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:06.196643 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.196616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:06.288934 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.288894    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f79df684-rfrnc"]
Oct 30 20:27:06.292791 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.292772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.346656 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346629    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qpbct\""
Oct 30 20:27:06.346850 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346691    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:27:06.346850 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346728    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:27:06.346850 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346728    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:27:06.347007 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346867    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:27:06.347007 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.346869    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tf8n6fqig7s7\""
Oct 30 20:27:06.352023 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.351997    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f79df684-rfrnc"]
Oct 30 20:27:06.381844 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.381812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382070 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382138 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382192 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382236 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382356 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.382431 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.382374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv4hl\" (UniqueName: \"kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483240 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483240 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4hl\" (UniqueName: \"kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:06.483440 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.483708 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.484073 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.483864    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.484373 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.484347    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.484773 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.484750    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.486104 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.486082    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.486826 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.486804    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.487262 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.487243    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.534494 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.534477    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:27:06.535085 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.535071    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:27:06.541769 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.541752    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4hl\" (UniqueName: \"kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.546704 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.546682    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:06.546843 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.546820    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:06.568801 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.568774    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"]
Oct 30 20:27:06.572531 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:06.572506    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0ec03d_f2fb_449d_808b_a22d38de3a1c.slice/crio-2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9 WatchSource:0}: Error finding container 2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9: Status 404 returned error can't find the container with id 2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9
Oct 30 20:27:06.583778 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.583758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:06.604345 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.604320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:06.634799 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.634774    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:27:06.656381 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.656334    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78mnk\""
Oct 30 20:27:06.661284 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.661263    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5tplx\""
Oct 30 20:27:06.666227 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.666157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:06.671291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.671271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:06.694875 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.694843    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:27:06.698383 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.698326    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:06.895531 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.895492    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc" event={"ID":"cf0ec03d-f2fb-449d-808b-a22d38de3a1c","Type":"ContainerStarted","Data":"2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9"}
Oct 30 20:27:06.956178 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.956151    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-674f9d7465-lpx8q"]
Oct 30 20:27:06.960845 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.960824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:06.965596 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.965575    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mkv2p\""
Oct 30 20:27:06.975681 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:06.975658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:07.014591 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.014557    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:27:07.014750 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.014684    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:27:07.014861 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.014846    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:27:07.014986 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.014969    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qn48m\""
Oct 30 20:27:07.015036 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.014970    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:27:07.063697 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.063676    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:27:07.065557 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.065535    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:27:07.072539 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:07.072515    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c476b7_f6d3_4ca0_bda3_2730fe09e1db.slice/crio-57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05 WatchSource:0}: Error finding container 57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05: Status 404 returned error can't find the container with id 57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05
Oct 30 20:27:07.086674 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:07.086655    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6215d32_ffbd_4fbf_a13d_3df9527fcd53.slice/crio-9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab WatchSource:0}: Error finding container 9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab: Status 404 returned error can't find the container with id 9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab
Oct 30 20:27:07.087423 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:07.087404    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c98799_681b_46ea_8dfd_1081c6ecbd34.slice/crio-92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789 WatchSource:0}: Error finding container 92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789: Status 404 returned error can't find the container with id 92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789
Oct 30 20:27:07.088258 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088258 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ggdj\" (UniqueName: \"kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088518 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.088674 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.088527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.115130 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.115111    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-674f9d7465-lpx8q"]
Oct 30 20:27:07.116425 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.116411    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f79df684-rfrnc"]
Oct 30 20:27:07.121165 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.120422    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn2wd"]
Oct 30 20:27:07.122244 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.122221    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s48cm"]
Oct 30 20:27:07.189538 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189619 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ggdj\" (UniqueName: \"kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189619 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189619 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189772 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189772 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189772 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.189772 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.189758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.190629 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.190603    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.190731 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.190635    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.191052 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.191028    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.193599 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.193572    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.193699 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.193571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.193699 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.193676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.194892 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.194867    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.248117 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.248090    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ggdj\" (UniqueName: \"kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.279590 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.279572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:07.358025 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.357999    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b59b5"]
Oct 30 20:27:07.360971 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:07.360945    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9d910_0c75_4701_8745_01683f4ad8da.slice/crio-354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32 WatchSource:0}: Error finding container 354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32: Status 404 returned error can't find the container with id 354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32
Oct 30 20:27:07.660645 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.660615    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-674f9d7465-lpx8q"]
Oct 30 20:27:07.663894 ip-10-0-135-188 kubenswrapper[2577]: W1030 20:27:07.663856    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252c4068_aec5_4b0e_bab8_e836652aac9a.slice/crio-74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0 WatchSource:0}: Error finding container 74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0: Status 404 returned error can't find the container with id 74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0
Oct 30 20:27:07.903771 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.903730    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q" event={"ID":"252c4068-aec5-4b0e-bab8-e836652aac9a","Type":"ContainerStarted","Data":"74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0"}
Oct 30 20:27:07.905007 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.904975    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b59b5" event={"ID":"58a9d910-0c75-4701-8745-01683f4ad8da","Type":"ContainerStarted","Data":"354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32"}
Oct 30 20:27:07.907505 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.907476    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"958cab57bf5d8e485b68c97f25f1dd483d9c0695e13aecd98a627c17efbac3e5"}
Oct 30 20:27:07.907625 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.907541    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"e1315787ec207913fe3d17ce87cf84dd89a456157004118dec1d29e91642b0a8"}
Oct 30 20:27:07.907625 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.907581    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"766e446a2f3b6cd96b924dc725b04a443c6d582c219ea6b54bcd2084c869217d"}
Oct 30 20:27:07.908659 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.908631    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tn2wd" event={"ID":"c6215d32-ffbd-4fbf-a13d-3df9527fcd53","Type":"ContainerStarted","Data":"9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab"}
Oct 30 20:27:07.909828 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.909804    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s48cm" event={"ID":"e4c98799-681b-46ea-8dfd-1081c6ecbd34","Type":"ContainerStarted","Data":"92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789"}
Oct 30 20:27:07.911136 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:07.911066    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc" event={"ID":"01c476b7-f6d3-4ca0-bda3-2730fe09e1db","Type":"ContainerStarted","Data":"57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05"}
Oct 30 20:27:08.918039 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:08.918010    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc" event={"ID":"cf0ec03d-f2fb-449d-808b-a22d38de3a1c","Type":"ContainerStarted","Data":"96ac48b34c36060c27f69a4be4f745afd27430e4808820857d37787f14135b3d"}
Oct 30 20:27:08.920628 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:08.920584    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:08.925494 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:08.925447    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:08.926563 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:08.926465    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"38248d148c58177367a065fe98a32ead0c3100c723984e02f8fbe7563a6830d4"}
Oct 30 20:27:09.041323 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.040502    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc" podStartSLOduration=1.932936263 podStartE2EDuration="4.040484572s" totalImagesPullingTime="2.107548309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:09.03910832 +0000 UTC m=+68.980856630" watchObservedRunningTime="2026-10-30 20:27:09.040484572 +0000 UTC m=+68.982232883"
Oct 30 20:27:09.948072 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.948032    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"741caa4bd993adf1506146f1ef8a6728264d7d26d6f5a734286719f28eab2fc6"}
Oct 30 20:27:09.948561 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.948150    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" event={"ID":"869e6098-8b18-4a7c-baa5-f4e2db8f5a97","Type":"ContainerStarted","Data":"0afd28399bebb7927931d7a9039c48838276bb023b2a761aa745ec11b1a21e5d"}
Oct 30 20:27:09.949107 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.949080    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:09.959749 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.959717    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s48cm" event={"ID":"e4c98799-681b-46ea-8dfd-1081c6ecbd34","Type":"ContainerStarted","Data":"b097c58ddc74231b0235c93f5ac6dc601ee11bef77f63527b531f3c4c4a6d8ac"}
Oct 30 20:27:09.959870 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.959779    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s48cm" event={"ID":"e4c98799-681b-46ea-8dfd-1081c6ecbd34","Type":"ContainerStarted","Data":"b3beb3e776417eb7611bcd9df4573cb88fb044cd446fe18d5d7633e04648f8b1"}
Oct 30 20:27:09.962392 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:09.962315    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc" event={"ID":"01c476b7-f6d3-4ca0-bda3-2730fe09e1db","Type":"ContainerStarted","Data":"f67e285e6afe9044b1618e0d7b4d02bf8ee49f4645d9a779461b7596520db0bf"}
Oct 30 20:27:10.071843 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:10.070425    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9" podStartSLOduration=3.063726259 podStartE2EDuration="7.070409085s" totalImagesPullingTime="4.006682826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:27:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:10.069347183 +0000 UTC m=+70.011095494" watchObservedRunningTime="2026-10-30 20:27:10.070409085 +0000 UTC m=+70.012157492"
Oct 30 20:27:10.186702 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:10.186643    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s48cm" podStartSLOduration=68.281727874 podStartE2EDuration="1m10.186623477s" totalImagesPullingTime="1.904895603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:10.18511284 +0000 UTC m=+70.126861149" watchObservedRunningTime="2026-10-30 20:27:10.186623477 +0000 UTC m=+70.128371789"
Oct 30 20:27:10.303717 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:10.303655    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc" podStartSLOduration=1.662993364 podStartE2EDuration="4.303634504s" totalImagesPullingTime="2.64064114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:10.30232983 +0000 UTC m=+70.244078151" watchObservedRunningTime="2026-10-30 20:27:10.303634504 +0000 UTC m=+70.245382813"
Oct 30 20:27:11.971833 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:11.971795    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q" event={"ID":"252c4068-aec5-4b0e-bab8-e836652aac9a","Type":"ContainerStarted","Data":"3ca01d3c3ddb43047713e0d2d06ebb2ac1b34653f001fc2c1ac394d41a665bd2"}
Oct 30 20:27:11.974108 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:11.974044    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b59b5" event={"ID":"58a9d910-0c75-4701-8745-01683f4ad8da","Type":"ContainerStarted","Data":"2123d90321c5525ba6f0ea5e082c4c586af350980ba473be564fcbe573567023"}
Oct 30 20:27:11.974214 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:11.974171    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:12.099018 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:12.098935    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b59b5" podStartSLOduration=67.605672181 podStartE2EDuration="1m12.098904156s" totalImagesPullingTime="4.493231975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:12.098625292 +0000 UTC m=+72.040373601" watchObservedRunningTime="2026-10-30 20:27:12.098904156 +0000 UTC m=+72.040652466"
Oct 30 20:27:12.980291 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:12.980243    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q" event={"ID":"252c4068-aec5-4b0e-bab8-e836652aac9a","Type":"ContainerStarted","Data":"07a42427a9d0bcbe8a1c51f40b332889ac83938a2351bd8084932263ac17cb05"}
Oct 30 20:27:12.980704 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:12.980326    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q" event={"ID":"252c4068-aec5-4b0e-bab8-e836652aac9a","Type":"ContainerStarted","Data":"803199dbc3ad883db9016ef6900380aa5adf65e8ef6ab7d48e9c1e074241deb6"}
Oct 30 20:27:13.204241 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:13.204179    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q" podStartSLOduration=2.460084122 podStartE2EDuration="7.204159397s" totalImagesPullingTime="4.744075275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:27:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:13.153606208 +0000 UTC m=+73.095354514" watchObservedRunningTime="2026-10-30 20:27:13.204159397 +0000 UTC m=+73.145907708"
Oct 30 20:27:13.956601 ip-10-0-135-188 kubenswrapper[2577]: I1030 20:27:13.956472    2577 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:27:13.956654 ip-10-0-135-188 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:27:13.966618 ip-10-0-135-188 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:27:13.966790 ip-10-0-135-188 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:27:13.966837 ip-10-0-135-188 systemd[1]: kubelet.service: Consumed 3.729s CPU time.
Oct 30 20:27:13.975582 ip-10-0-135-188 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:27:14.037813 ip-10-0-135-188 kubenswrapper[5446]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:27:14.037813 ip-10-0-135-188 kubenswrapper[5446]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:27:14.037813 ip-10-0-135-188 kubenswrapper[5446]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:27:14.038345 ip-10-0-135-188 kubenswrapper[5446]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:27:14.040010 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.039936    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.040010 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040010    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040014    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040017    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040020    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040023    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040026    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040028    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040031    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040033    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040037    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040039    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040042    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040044    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040047    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040049    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040052    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040055    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040058    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040061    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040064    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.040092 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040067    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040069    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040072    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040075    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040078    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040080    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040083    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040085    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040088    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040090    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040093    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040096    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040098    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040101    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040104    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040106    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040115    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040118    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040120    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.040562 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040123    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040125    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040128    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040131    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040133    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040136    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040139    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040141    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040144    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040146    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040149    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040152    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040154    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040156    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040159    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040162    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040164    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040167    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040170    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040172    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.041043 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040175    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040177    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040180    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040182    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040185    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040188    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040190    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040193    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040197    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040201    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040209    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040213    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040216    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040219    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040222    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040225    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040228    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040230    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040233    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.041519 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040236    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040238    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040241    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040244    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040246    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040249    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040251    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040254    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040256    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040259    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040262    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040264    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040267    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040269    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040272    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040274    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040277    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040279    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040281    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.041993 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040284    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040289    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040293    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040296    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040299    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040307    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040310    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.040313    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041163    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041171    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041174    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041177    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041180    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041183    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041187    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041191    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041194    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041197    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041200    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.042474 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041202    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041205    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041208    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041212    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041214    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041217    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041219    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041222    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041225    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041227    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041230    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041232    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041235    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041237    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041240    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041242    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041245    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041248    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041250    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041254    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.042943 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041256    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041259    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041262    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041264    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041267    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041270    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041272    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041275    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041278    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041280    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041282    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041285    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041288    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041290    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041292    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041295    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041298    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041300    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041303    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041305    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.043452 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041308    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041311    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041313    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041316    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041319    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041322    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041324    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041327    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041329    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041332    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041334    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041337    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041340    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041342    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041345    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041347    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041350    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041352    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041355    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.043964 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041357    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041360    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041362    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041365    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041367    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041370    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041372    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041375    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041379    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041382    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041384    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041387    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041389    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041392    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041394    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041397    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041399    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041402    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041404    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.044423 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041407    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041409    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041412    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041414    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041417    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041419    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041422    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041425    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041427    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041430    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041434    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041438    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041441    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041444    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041447    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041449    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041452    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041891    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041896    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041899    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.045091 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041902    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041905    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041908    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041911    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041933    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041936    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041939    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041941    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041944    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041947    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041950    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041952    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041955    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041957    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041961    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041965    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041969    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041971    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041974    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.045784 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041978    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041980    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041983    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041985    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041988    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041990    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041993    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041995    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.041998    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042001    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042003    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042006    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042008    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042013    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042016    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042019    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042022    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042025    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042028    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.046289 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042030    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042032    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042035    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042038    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042040    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042043    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042045    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042047    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042050    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042052    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042055    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042057    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042060    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042063    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042065    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042068    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042071    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042074    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042076    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042079    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.046793 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042081    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042084    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042086    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042089    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042091    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042094    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042096    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042099    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042101    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042104    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042107    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042109    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042112    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042114    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042117    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042120    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042122    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042125    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042127    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.047303 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042130    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042132    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042135    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042137    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042140    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042142    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042144    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042147    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042153    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042156    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042158    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042161    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042163    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042166    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042168    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042171    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042173    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042176    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042178    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042181    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.047758 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042183    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042186    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042188    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042194    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042196    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042200    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042299    5446 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042310    5446 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042316    5446 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042321    5446 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042325    5446 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042328    5446 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042333    5446 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042337    5446 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042340    5446 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042343    5446 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042346    5446 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042350    5446 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042353    5446 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042356    5446 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042360    5446 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042364    5446 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042367    5446 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:27:14.048243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042370    5446 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042373    5446 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042376    5446 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042379    5446 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042382    5446 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042385    5446 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042399    5446 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042402    5446 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042405    5446 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042408    5446 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042411    5446 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042414    5446 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042418    5446 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042421    5446 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042424    5446 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042429    5446 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042432    5446 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042434    5446 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042437    5446 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042440    5446 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042443    5446 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042452    5446 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042455    5446 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042458    5446 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:27:14.048773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042461    5446 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042464    5446 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042472    5446 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042475    5446 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042478    5446 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042485    5446 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042488    5446 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042491    5446 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042495    5446 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042498    5446 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042501    5446 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042504    5446 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042507    5446 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042511    5446 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042514    5446 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042517    5446 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042520    5446 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042523    5446 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042526    5446 flags.go:64] FLAG: --help="false"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042529    5446 flags.go:64] FLAG: --hostname-override="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042533    5446 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042536    5446 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042539    5446 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:27:14.049359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042542    5446 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042546    5446 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042549    5446 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042551    5446 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042554    5446 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042557    5446 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042560    5446 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042563    5446 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042566    5446 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042568    5446 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042572    5446 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042575    5446 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042578    5446 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042580    5446 flags.go:64] FLAG: --lock-file=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042584    5446 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042587    5446 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042590    5446 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042600    5446 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042603    5446 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042606    5446 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042609    5446 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042612    5446 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042615    5446 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042618    5446 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042620    5446 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:27:14.049897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042625    5446 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042628    5446 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042631    5446 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042634    5446 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042639    5446 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042642    5446 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042645    5446 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042647    5446 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042650    5446 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042653    5446 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042660    5446 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042664    5446 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042666    5446 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042669    5446 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042672    5446 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042675    5446 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042678    5446 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042681    5446 flags.go:64] FLAG: --port="10250"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042684    5446 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042687    5446 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-09c829cd118fbec6a"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042690    5446 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042694    5446 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042697    5446 flags.go:64] FLAG: --register-node="true"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042700    5446 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042703    5446 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042707    5446 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:27:14.050534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042710    5446 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042713    5446 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042717    5446 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042720    5446 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042723    5446 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042726    5446 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042728    5446 flags.go:64] FLAG: --runonce="false"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042731    5446 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042734    5446 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042737    5446 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042741    5446 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042744    5446 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042747    5446 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042750    5446 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042753    5446 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042756    5446 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042759    5446 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042762    5446 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042765    5446 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042767    5446 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042770    5446 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042773    5446 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042778    5446 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042781    5446 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042785    5446 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:27:14.051169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042788    5446 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042791    5446 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042795    5446 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042798    5446 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042800    5446 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042803    5446 flags.go:64] FLAG: --v="2"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042808    5446 flags.go:64] FLAG: --version="false"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042813    5446 flags.go:64] FLAG: --vmodule=""
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042817    5446 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.042820    5446 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042966    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042971    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042974    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042977    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042979    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042982    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042985    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042989    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042992    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042994    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042997    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.042999    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.051858 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043002    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043004    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043007    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043009    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043012    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043015    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043017    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043020    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043023    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043025    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043028    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043030    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043034    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043036    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043039    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043041    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043044    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043047    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043050    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043053    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.052544 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043056    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043058    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043061    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043063    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043065    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043068    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043070    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043074    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043077    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043080    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043082    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043085    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043087    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043089    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043092    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043094    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043097    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043100    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043102    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043104    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.053048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043107    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043110    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043112    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043114    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043118    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043121    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043123    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043126    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043128    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043131    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043133    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043136    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043140    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043144    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043147    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043149    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043152    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043154    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043157    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.053643 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043160    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043163    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043165    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043168    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043171    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043173    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043176    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043178    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043181    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043183    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043186    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043188    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043191    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043194    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043196    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043199    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043201    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043205    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043208    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043211    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.054159 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043213    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043216    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043218    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043220    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043223    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043226    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043228    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043231    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043233    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043236    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043240    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043244    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043248    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043251    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043254    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.054641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.043280    5446 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043317    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043321    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043324    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043326    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043329    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043332    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043334    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043337    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043339    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043342    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043344    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043347    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043349    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043353    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043355    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043358    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043360    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043363    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.055149 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043365    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043368    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043371    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043373    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043376    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043379    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043381    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043384    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043387    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043389    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043392    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043396    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043398    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043402    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043406    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043409    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043412    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043414    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043417    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.055759 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043420    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043422    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043424    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043427    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043430    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043432    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043434    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043437    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043441    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043443    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043446    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043448    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043450    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043453    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043456    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043458    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043461    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043463    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043467    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043469    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.056355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043472    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043474    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043477    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043479    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043482    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043485    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043487    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043490    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043494    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043496    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043499    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043502    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043504    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043506    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043509    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043511    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043514    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043516    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043519    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043521    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.056833 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043525    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043527    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043530    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043532    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043534    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043537    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043540    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043542    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043545    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043547    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043550    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043553    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043556    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043558    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043561    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043563    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043566    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043568    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043571    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.057333 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043573    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043575    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043578    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043580    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043585    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043588    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043591    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043594    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043596    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.043598    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.047698    5446 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.047713    5446 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.047730    5446 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.047735    5446 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047788    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047793    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047796    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047799    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047802    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.057825 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047805    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047808    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047810    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047813    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047816    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047818    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047821    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047823    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047826    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047829    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047831    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047834    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047836    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047839    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047842    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047844    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047846    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047849    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047852    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047855    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.058601 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047857    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047860    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047863    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047866    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047869    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047871    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047874    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047878    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047881    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047885    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047888    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047891    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047894    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047896    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047899    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047901    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047904    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047906    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047909    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.059385 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047928    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047932    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047936    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047941    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047943    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047946    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047949    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047951    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047954    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047956    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047959    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047961    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047964    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047967    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047969    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047972    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047976    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047978    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047981    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.060040 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047983    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047986    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047988    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047991    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047993    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047996    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.047998    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048001    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048003    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048006    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048008    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048011    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048013    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048016    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048018    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048021    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048024    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048027    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048029    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048032    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.060675 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048034    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048037    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048039    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048042    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048044    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048047    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048049    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048052    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048054    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048057    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048059    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048062    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048064    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048067    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048071    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048074    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048077    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048080    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048082    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.061318 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048085    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048088    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048090    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048092    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.048120    5446 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048259    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048264    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048267    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048270    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048273    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048276    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048278    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048281    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048283    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048285    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048288    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.061906 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048290    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048293    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048295    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048298    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048300    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048303    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048306    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048308    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048311    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048314    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048316    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048319    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048322    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048326    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048329    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048332    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048334    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048337    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048340    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048342    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.062306 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048345    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048347    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048351    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048355    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048358    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048361    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048365    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048369    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048371    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048374    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048377    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048379    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048382    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048384    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048387    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048390    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048392    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048395    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048398    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.062790 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048400    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048402    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048405    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048408    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048410    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048413    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048417    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048420    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048422    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048425    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048427    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048430    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048432    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048435    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048438    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048440    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048442    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048445    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048447    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.063364 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048450    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048453    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048456    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048459    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048461    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048464    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048466    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048469    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048471    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048474    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048476    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048479    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048481    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048484    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048486    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048489    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048491    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048494    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048496    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.063799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048500    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048503    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048505    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048508    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048510    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048513    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048515    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048518    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048520    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048523    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048526    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048528    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048531    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048533    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048536    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048538    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048541    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.064301 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048544    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.048567    5446 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048598    5446 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048602    5446 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048605    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048608    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048612    5446 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048614    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048617    5446 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048620    5446 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048622    5446 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048625    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048627    5446 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048630    5446 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048632    5446 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048635    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:27:14.064704 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048638    5446 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048641    5446 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048643    5446 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048646    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048648    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048651    5446 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048653    5446 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048657    5446 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048659    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048662    5446 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048665    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048667    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048670    5446 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048674    5446 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048676    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048679    5446 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048682    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048685    5446 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048687    5446 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048690    5446 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:27:14.065108 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048694    5446 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048698    5446 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048701    5446 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048704    5446 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048708    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048711    5446 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048713    5446 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048716    5446 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048718    5446 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048721    5446 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048723    5446 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048726    5446 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048730    5446 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048732    5446 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048735    5446 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048738    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048741    5446 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048743    5446 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048746    5446 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048748    5446 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:27:14.065578 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048751    5446 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048753    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048756    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048758    5446 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048761    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048764    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048767    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048770    5446 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048773    5446 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048776    5446 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048779    5446 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048782    5446 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048784    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048787    5446 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048790    5446 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048792    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048795    5446 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048797    5446 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048800    5446 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:27:14.066049 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048802    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048805    5446 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048807    5446 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048810    5446 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048812    5446 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048816    5446 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048818    5446 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048821    5446 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048823    5446 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048826    5446 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048829    5446 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048831    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048834    5446 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048836    5446 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048839    5446 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048841    5446 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048844    5446 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048847    5446 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048850    5446 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048853    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:27:14.066529 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048855    5446 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048858    5446 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048860    5446 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048863    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048866    5446 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048868    5446 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048871    5446 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048873    5446 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048876    5446 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048878    5446 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048881    5446 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048883    5446 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:14.048886    5446 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.048949    5446 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.049853    5446 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.049949    5446 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.050129    5446 server.go:1014] "Starting client certificate rotation"
Oct 30 20:27:14.067037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.050277    5446 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.050323    5446 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:21:00 +0000 UTC" deadline="2028-04-18 05:20:09.893232913 +0000 UTC"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.050350    5446 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12848h52m55.842884627s"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.050586    5446 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.051603    5446 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.053185    5446 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.055079    5446 log.go:25] "Validated CRI v1 image API"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.055727    5446 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:27:14.067478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.057704    5446 fs.go:135] Filesystem UUIDs: map[360de9a3-37eb-4ba1-bf4e-6af398c462cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f72330eb-5d5e-47fc-91f2-3389f35b10dd:/dev/nvme0n1p4]
Oct 30 20:27:14.067762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.057720    5446 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32/userdata/shm major:0 minor:315 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05/userdata/shm major:0 minor:308 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05/userdata/shm major:0 minor:253 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0/userdata/shm major:0 minor:345 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab/userdata/shm major:0 minor:311 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~projected/kube-api-access-qv4hl:{mountpoint:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~projected/kube-api-access-qv4hl major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03a2d959-f0ce-422a-8132-74000b5383a0/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/03a2d959-f0ce-422a-8132-74000b5383a0/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ce3e873-bfb3-4ae8-a487-6875c50aedc1/volumes/kubernetes.io~projected/kube-api-access-tppgj:{mountpoint:/var/lib/kubelet/pods/1ce3e873-bfb3-4ae8-a487-6875c50aedc1/volumes/kubernetes.io~projected/kube-api-access-tppgj major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~projected/kube-api-access-2ggdj:{mountpoint:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~projected/kube-api-access-2ggdj major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e7f593f-c940-495e-8c54-bd999ee243d8/volumes/kubernetes.io~projected/kube-api-access-psn57:{mountpoint:/var/lib/kubelet/pods/2e7f593f-c940-495e-8c54-bd999ee243d8/volumes/kubernetes.io~projected/kube-api-access-psn57 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~projected/kube-api-access-mngg4:{mountpoint:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~projected/kube-api-access-mngg4 major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:251 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~projected/kube-api-access-g6dtn:{mountpoint:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~projected/kube-api-access-g6dtn major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/444c4868-604d-4d77-8686-d42468026f4a/volumes/kubernetes.io~projected/kube-api-access-fwvr6:{mountpoint:/var/lib/kubelet/pods/444c4868-604d-4d77-8686-d42468026f4a/volumes/kubernetes.io~projected/kube-api-access-fwvr6 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c19a307-d372-4008-abfa-de10f66837c1/volumes/kubernetes.io~projected/kube-api-access-xjfgg:{mountpoint:/var/lib/kubelet/pods/4c19a307-d372-4008-abfa-de10f66837c1/volumes/kubernetes.io~projected/kube-api-access-xjfgg major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/58a9d910-0c75-4701-8745-01683f4ad8da/volumes/kubernetes.io~projected/kube-api-access-jj7cr:{mountpoint:/var/lib/kubelet/pods/58a9d910-0c75-4701-8745-01683f4ad8da/volumes/kubernetes.io~projected/kube-api-access-jj7cr major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/603efcb0-0cdc-447b-892a-fc99c798030a/volumes/kubernetes.io~projected/kube-api-access-wf7ch:{mountpoint:/var/lib/kubelet/pods/603efcb0-0cdc-447b-892a-fc99c798030a/volumes/kubernetes.io~projected/kube-api-access-wf7ch major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/658c1529-f42f-4f3d-9798-cff3600c2772/volumes/kubernetes.io~projected/kube-api-access-bcshw:{mountpoint:/var/lib/kubelet/pods/658c1529-f42f-4f3d-9798-cff3600c2772/volumes/kubernetes.io~projected/kube-api-access-bcshw major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~projected/kube-api-access-648mr:{mountpoint:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~projected/kube-api-access-648mr major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~projected/kube-api-access-44lgl:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~projected/kube-api-access-44lgl major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~projected/kube-api-access-fvgtg:{mountpoint:/var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~projected/kube-api-access-fvgtg major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~projected/kube-api-access-v8zcj:{mountpoint:/var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~projected/kube-api-access-v8zcj major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~projected/kube-api-access-4jvjg:{mountpoint:/var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~projected/kube-api-access-4jvjg major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~projected/kube-api-access-pdl7j:{mountpoint:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~projected/kube-api-access-pdl7j major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6215d32-ffbd-4fbf-a13d-3df9527fcd53/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c6215d32-ffbd-4fbf-a13d-3df9527fcd53/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~projected/kube-api-access-dgl9v:{mountpoint:/var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~projected/kube-api-access-dgl9v major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~projected/kube-api-access-d9pxd:{mountpoint:/var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~projected/kube-api-access-d9pxd major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~secret/metrics-certs major:0 minor:304 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/9138e85af9f0779812f700c595ee52aeee0c020c998cdd03e796f4fca1878e08/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/3ec44b27e9ecad1e341b8d54746b1d6c6f1a20e32bc72f5537d768236cc59dcc/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/6d87a89d096fe9235e4a13fc44eedf6b10f647f460014553fe6d40b3cdab08bd/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/80dff9f4c485bc3ad73ec8038b552f270074ab7d1bc15287d75b409db262f855/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/202a9dafdeb9eafdff8b3621cfb2a316ea646f95106ad71eccba76e255300965/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/768243405a2c1214b73d3921b601378b3c83bac3a03fea3ef7f243455cb685cd/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/857190d02bdd707cd455a665bfbe5af20ee48ae05c70d9bd6aa8f2177325da5a/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/04b4aa846931ae0ff9f966917e866ad27a9928bf6cb4467ca2c70266eb99f4a0/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d8cc93db89f9e31d83327607e8235efe62c7c7935919e6a6cfa5e85992af521a/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/55ed0af53f27b445f9313464afe63663be5d3dc92a25cac2143dcbe142019d59/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/f25120b3757da540ce9f2522706033fce89ea7012358981d3961064efafec997/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/a99fc7a9b066109bf9833da48cf2529b98c7a7b0fb1a5f0108b81e702d693844/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/b8850206dd73ea50ce09f308a0eaf7ca0e59618017f2c1a2fce137de55ddc527/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/8455864413a33f0f63675d6f5654477c054e1c86b404e2806c5fd428f92e5fe1/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a93b0c1740b70b69a3bc08dc45b1a7f3e0fd1b1a6aa2da4824d9cad377d6770a/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/b7d2d454dded17917901695be2f4063b00fe9c3a2f9965816e92454619a1dd00/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/3fd49de3cae4da295179d48cf69153b8cca25ea6df09ff3c5a5c503f288e0f37/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/2cae02ea8dc20db792cd02590191893e77e7c14980ba640ba694bb755ef424ef/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/b3918538d21a2a4eeae6b4e0ab3ed88abf338433266d21686f65ab96490b44aa/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/9113fcb8cf1b6f2626e843154f8c0fef209bf049dbd95c07e402dfb1dbf3cf09/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f61f3f69a6b6d0ce7869eb734980598d2657a558b33125a8d0c6f4aaa324642c/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/d8179b24b935242bf53a11edb2bb51665294dda1dc1cba3d05737377736a2da7/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/47eb28e3e98c4e70fe081868df23777e505ec810ef2198ad91b1b238f03036dd/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/3a7acccefa72f763a040e09f0edcbd278265bd7f637e5bba107bc6aba481272a/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/309c03d260056149b6a14a16e27691ce5f34bcdeb4aa8a17991f43683e893138/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/4bfd9ba827bbbd45ebb165ce5638da3bfbf40db539ce605892dd9b90d56be9c2/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/660aa40f4375fe6e2b906eeab43a77d756b9d3312450c99f7bc219391544647f/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/7e8f9e0906d0d22a997e1701ac32d4fa860d9327a847759fad42d0d3c842fe30/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/2f6e5f5266d911d84470b2fb36a6cf05a70b7368fed295cc2429688283c5681f/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/c81750887d70246f8b130ef6001644d9319189db5860b1d96d049825254eff21/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/1cd7d1df606ea63d8913ce4d4a104bd56a30d9c095cff5b431c7a0fa638f4192/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-257:{mountpoint:/var/lib/containers/storage/overlay/4eeb0cb1cac4387827b8bb2ed923ffff6458e2893040663c63445be0b18ac048/merged major:0 minor:257 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/c6f2ae7788d9847bee7f8feb5c3cf362d4bb484cb9d6416f612a470679b75d5a/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/c257308f52c7c7b58ae7625eaa1ac6b17fe4ce4bb87de156a82a91cd7349482c/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/d4e2c74a06251670cab52fdf6d5b1ab29bb99eb3f7d9a5b142fa82afb516c779/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/ab6740d878416e56010b2670fad5243b8da0eea8d01204572a1d7c5461314282/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/05fbb55577758de815d8deca767ee395f412b1d2978b1bb9c8e5e594188f90d0/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/013a4e37c210fca7f7eb28e391f215c06d7d9f6df15501f56332d56299e643ef/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/f0ec824c59650717fd40d5bed7b7d58200d96e5d27bf90ca08f7880a1f5b5a39/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/0e7243c4e02589e812b2096486fc296137c31fd0d7c0bbcfc8d25529e92d2960/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/36589bdc3b9d0280ebc03d495117def97912121475458a43e7ce65f5bcad734e/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/e32b6eaec508f08d11c24cf974f9f1a42dbfc56adfe042d4be6aaee871244d9e/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/feb5d356dc07c2dfee3861e2f5042b7cdfa855306857d443b266ec9d46456784/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/165bb4e5d24a9b5f30798464e7d933ed0862fc1a779af323d71a6cd26eafd885/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/6051fe89e5a8f41dbfc0064738b04ce20eb0ded3ce8660b11f05e958a997d5b5/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/c072babfeeab201b4152b6606f97469590951bc722db46c4d712659e0e393abb/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/50d02d401edef4d47313d5274aae054f647539c8f464ea14bba061f69f86d70f/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/8975279af684166126b0c7aa80becbf44aacbd6d2dc9c550f85f969602f331c5/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/96b984787c84bcea35e94f9a2ef917b487abd88b05026d24a356baf969b36001/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/d5c10dd717fb53576c5682fb2b44e1693eb724c32591f33e62bb71e3b92ac310/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/7039c62a05d50a257e3d8ee92f2872577751ea9466d7aded1238c63fbacf2fd5/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/ed2aeb3392841dd955b08ce242d0334564b73383bea21e20e5a59c9e8346f735/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/ab32f3b37781cce4a704a6d778b1cda10f9d41f235a23a8669f6213075e2325f/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/c760633ad1dee386176b9efd5314d38bb47f45d1ec161153060dcf683ae75280/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/327aab5e20017d45e36c46d4b2226f2e2eee1f68ac6e91756063c0153a4c5dcb/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/c774153462f7872184a8e4a7d10a658ec1568c88569e88dac03026e03ebd5ef3/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/8dee11d2d456cb5a34ea79b9359dc019bf30f4e442483a00f2ff8ccbcb262359/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/513e892014388ef660d4672149543035f98a1ad6feb820a8edd7eb68a3488534/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/09fab4340f938bbd71332d19fed4908d1225f35d341046dfe91beeeb7466d00b/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/0a6ca6a133afea3bbe8bbe44d88459b95f440a2f8cc804ac921002e7350ea861/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/acd249edfeed209504e2e1987efc9529766a2b591abf0a17f627b1033fd2af95/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/504012fb72d48a7194a524874ab5b092cc6b7b6dda00651b0f70040a8b45cf12/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/65e23c7221343eac36fe2e3a7cb90b038e330c2e9fb2681025fdd0e1b30bd105/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/1b165d18d12095caa43200e33ee2908ba05354c0da1faec38f3bacf56d8a8437/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/24fdfc902bfce5243d7d2e2b0fcd901f7eccf0479db8a28af7eda0ed92e8b409/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/61e8b630df47388f26fe573c4da4def0cff95382687ae86c5874c776d645efb3/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/009893e03f502aff2f975e0777d34a6a5e0e1c5ce4e72138302acdc33813385c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/873044dd19e4bad2f33863ac4dee3f188419cee2a8846aa1ce770f8898be767d/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066011    5446 manager.go:217] Machine: {Timestamp:2026-10-30 20:27:14.065556862 +0000 UTC m=+0.057559980 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096789 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec219f3c11d87b699949611d4b292ad5 SystemUUID:ec219f3c-11d8-7b69-9949-611d4b292ad5 BootID:edc6e22e-f8cb-424a-a9c9-2fae1b7a5699 Filesystems:[{Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/92c6a28fa70d3d17106b0dddb819385f34bb3bd49de1923ef744a032af14f789/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74ca0b144561c43941d3218305ba24ad716c1448c9703dd3f1687154d4302cf0/userdata/shm DeviceMajor:0 DeviceMinor:345 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/03a2d959-f0ce-422a-8132-74000b5383a0/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~projected/kube-api-access-4jvjg DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~projected/kube-api-access-44lgl DeviceMajor:0 DeviceMinor:291 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-257 DeviceMajor:0 DeviceMinor:257 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:334 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~projected/kube-api-access-v8zcj DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/58ccad2df4903fc4764b5e37c5267a050436a52a69c22fea32214075e74cfc05/userdata/shm DeviceMajor:0 DeviceMinor:253 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:289 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/57f999e7515a4be833f59749c93f1957e46f4c3a355cf5e1548efa3e38182d05/userdata/shm DeviceMajor:0 DeviceMinor:308 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7a53b57814255a2d9d8abe7a41c7d11b6fd2e1a3545dc7596c3919ecfbb016a0/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:333 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a28fd4f88773766a335d9274f8e62b2cdea0bad1192eb679e0b692684fa78612/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:246 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:270 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:290 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/658c1529-f42f-4f3d-9798-cff3600c2772/volumes/kubernetes.io~projected/kube-api-access-bcshw DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/2e7f593f-c940-495e-8c54-bd999ee243d8/volumes/kubernetes.io~projected/kube-api-access-psn57 DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3e51ac73-92e8-48e1-a0ef-5ba865824e80/volumes/kubernetes.io~projected/kube-api-access-g6dtn DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:300 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:301 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~projected/kube-api-access-2ggdj DeviceMajor:0 DeviceMinor:340 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:286 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:302 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:331 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/af2197b8-f824-455b-8229-555a994abbac/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:282 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1ce3e873-bfb3-4ae8-a487-6875c50aedc1/volumes/kubernetes.io~projected/kube-api-access-tppgj DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/603efcb0-0cdc-447b-892a-fc99c798030a/volumes/kubernetes.io~projected/kube-api-access-wf7ch DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8dd9b304cb163c1f9534a39693c160a1def82aab8bdf687292af1ad3ac0dd9af/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c19a307-d372-4008-abfa-de10f66837c1/volumes/kubernetes.io~projected/kube-api-access-xjfgg DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51/volumes/kubernetes.io~projected/kube-api-access-fvgtg DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~projected/kube-api-access-d9pxd DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d873d0ea19357c240c0926ab220a4f6293cc80fc667963a76a6a5ef5e3309ab/userdata/shm DeviceMajor:0 DeviceMinor:311 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~projected/kube-api-access-pdl7j DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/83b7e53c9942d26c2e74ec683997b82f25f039551e88603a0e241da33b84114d/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/154eea1b1342e07e02a8c8a30707e38b3e7c3c18b9a0a4b5f4df7f48339f1e67/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~projected/kube-api-access-mngg4 DeviceMajor:0 DeviceMinor:252 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01c476b7-f6d3-4ca0-bda3-2730fe09e1db/volumes/kubernetes.io~projected/kube-api-access-qv4hl DeviceMajor:0 DeviceMinor:303 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e4c98799-681b-46ea-8dfd-1081c6ecbd34/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:304 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/444c4868-604d-4d77-8686-d42468026f4a/volumes/kubernetes.io~projected/kube-api-access-fwvr6 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cc64cd88e975b46ce1def510008dd8081eafabfe33841aeaf783dfa6c9ea0e3e/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8baedd46269e781a621054fd7b01dc580b067965690f3b57344c6299e50a5435/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:296 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90e3fe3515c04177d9c5265b57d540513d83f42967c24d89a3b23aeed8332583/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:287 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/252c4068-aec5-4b0e-bab8-e836652aac9a/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:332 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c1fcc11f744142e56f0fa9f8f007d9eea9483b340d625d301e10551c78767bd4/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e7b9ca62ea4cb95d34c0bfbb729d7e7e8721d29be63f7fb3e27dad7fe648fb9/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f43050d88940e789c41d66c3855a083b3bf2ded7727d15d537f04e2b4136d60c/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2acf0e39a9fb8c0c04f6d1020f89bdf0943b9094389f2fb368b9a93749314c2/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f030b163746ffa44678898d9341a003074ea1103bfc9d4f338e997ed6c50e544/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cf0ec03d-f2fb-449d-808b-a22d38de3a1c/volumes/kubernetes.io~projected/kube-api-access-dgl9v DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ddf7308f50736b0b7305cdc7cdbbdb4bd2d80b96bff105b52885d8306c53d73e/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b125b89e-655d-488e-a4c5-96d870660ccb/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39c50552-39f0-4be4-9d70-ffade02c476f/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:251 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c6215d32-ffbd-4fbf-a13d-3df9527fcd53/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:305 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/58a9d910-0c75-4701-8745-01683f4ad8da/volumes/kubernetes.io~projected/kube-api-access-jj7cr DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/85fec599-5ad3-4971-a4ce-15f46736d55a/volumes/kubernetes.io~projected/kube-api-access-648mr DeviceMajor:0 DeviceMinor:269 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/354b28061c968e1cdf134ad6cd44b0f9112ccb5f1b0210dd6ba5709108785e32/userdata/shm DeviceMajor:0 DeviceMinor:315 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/869e6098-8b18-4a7c-baa5-f4e2db8f5a97/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:288 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:154eea1b1342e07 MacAddress:3a:81:50:08:1a:c2 Speed:10000 Mtu:8901} {Name:2e7b9ca62ea4cb9 MacAddress:0e:bc:e3:8f:9c:d3 Speed:10000 Mtu:8901} {Name:354b28061c968e1 MacAddress:de:9c:c9:05:2f:2e Speed:10000 Mtu:8901} {Name:57f999e7515a4be MacAddress:c2:9b:5d:11:2d:b6 Speed:10000 Mtu:8901} {Name:58ccad2df4903fc MacAddress:56:5e:1b:fb:0a:f2 Speed:10000 Mtu:8901} {Name:74ca0b144561c43 MacAddress:7e:63:e5:50:81:1a Speed:10000 Mtu:8901} {Name:83b7e53c9942d26 MacAddress:46:bd:83:81:4a:86 Speed:10000 Mtu:8901} {Name:92c6a28fa70d3d1 MacAddress:12:78:08:75:14:4a Speed:10000 Mtu:8901} {Name:9d873d0ea19357c MacAddress:32:ce:33:84:e2:26 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:66:24:eb:9b:d5 Speed:0 Mtu:9001} {Name:br-int MacAddress:1a:3d:62:9f:3a:3e Speed:0 Mtu:8901} {Name:c2acf0e39a9fb8c MacAddress:82:a6:9c:30:5c:0e Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:66:24:eb:9b:d5 Speed:0 Mtu:9001} {Name:f030b163746ffa4 MacAddress:ee:c1:fd:86:b5:27 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:12:71:d6:ad:bd:ed Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:96:77:7c:01:44:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066365    5446 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066429    5446 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066698    5446 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066718    5446 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-188.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066835    5446 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066843    5446 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066855    5446 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066868    5446 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.066971    5446 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067112    5446 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067222    5446 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067255    5446 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067264    5446 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067273    5446 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067281    5446 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.067289    5446 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.068057    5446 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:27:14.068119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.068069    5446 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:27:14.069293 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.068503    5446 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:27:14.071195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071177    5446 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:27:14.071195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071192    5446 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:27:14.071332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071311    5446 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:27:14.071524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071509    5446 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:27:14.071585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071548    5446 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:27:14.071673 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071662    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071680    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071689    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071698    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071707    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071716    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071724    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:27:14.071733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071733    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071744    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071754    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071773    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071787    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071822    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:27:14.072139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.071831    5446 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:27:14.075124 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.075109    5446 server.go:1263] "Started kubelet"
Oct 30 20:27:14.075221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.075195    5446 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:27:14.075328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.075258    5446 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:27:14.075394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.075371    5446 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:27:14.075593 ip-10-0-135-188 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:27:14.077053 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.077029    5446 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:27:14.077888 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.077863    5446 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:27:14.082370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082352    5446 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082379    5446 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082441    5446 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:21:02 +0000 UTC" deadline="2028-04-10 03:22:21.771136612 +0000 UTC"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082459    5446 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12654h55m7.688680871s"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082464    5446 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082476    5446 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.082491    5446 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.082671    5446 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084126    5446 factory.go:55] Registering systemd factory
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084145    5446 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084407    5446 factory.go:153] Registering CRI-O factory
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084427    5446 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084490    5446 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084509    5446 factory.go:103] Registering Raw factory
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084526    5446 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.084933    5446 manager.go:319] Starting recovery of all containers
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085192    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085246    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c19a307-d372-4008-abfa-de10f66837c1" volumeName="kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085260    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c19a307-d372-4008-abfa-de10f66837c1" volumeName="kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085273    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085285    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085296    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422" volumeName="kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085312    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422" volumeName="kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085322    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085335    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085347    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c50552-39f0-4be4-9d70-ffade02c476f" volumeName="kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085357    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e51ac73-92e8-48e1-a0ef-5ba865824e80" volumeName="kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085368    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085382    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf0ec03d-f2fb-449d-808b-a22d38de3a1c" volumeName="kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085392    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03a2d959-f0ce-422a-8132-74000b5383a0" volumeName="kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085407    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085418    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085429    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085445    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085458    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085470    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085482    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085493    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e7f593f-c940-495e-8c54-bd999ee243d8" volumeName="kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085505    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085547    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b125b89e-655d-488e-a4c5-96d870660ccb" volumeName="kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085562    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6215d32-ffbd-4fbf-a13d-3df9527fcd53" volumeName="kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085577    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085590    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e7f593f-c940-495e-8c54-bd999ee243d8" volumeName="kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085602    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="444c4868-604d-4d77-8686-d42468026f4a" volumeName="kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085623    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58a9d910-0c75-4701-8745-01683f4ad8da" volumeName="kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085637    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="658c1529-f42f-4f3d-9798-cff3600c2772" volumeName="kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085650    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b125b89e-655d-488e-a4c5-96d870660ccb" volumeName="kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085664    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf0ec03d-f2fb-449d-808b-a22d38de3a1c" volumeName="kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085677    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="444c4868-604d-4d77-8686-d42468026f4a" volumeName="kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085689    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085702    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085714    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c50552-39f0-4be4-9d70-ffade02c476f" volumeName="kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085726    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b125b89e-655d-488e-a4c5-96d870660ccb" volumeName="kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085737    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085747    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085758    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51" volumeName="kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085768    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03a2d959-f0ce-422a-8132-74000b5383a0" volumeName="kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085779    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c50552-39f0-4be4-9d70-ffade02c476f" volumeName="kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085791    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e51ac73-92e8-48e1-a0ef-5ba865824e80" volumeName="kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085820    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085832    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422" volumeName="kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085846    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af2197b8-f824-455b-8229-555a994abbac" volumeName="kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085857    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4c98799-681b-46ea-8dfd-1081c6ecbd34" volumeName="kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085869    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085881    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="603efcb0-0cdc-447b-892a-fc99c798030a" volumeName="kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085892    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085902    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51" volumeName="kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.085988    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ce3e873-bfb3-4ae8-a487-6875c50aedc1" volumeName="kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086002    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39c50552-39f0-4be4-9d70-ffade02c476f" volumeName="kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086017    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e51ac73-92e8-48e1-a0ef-5ba865824e80" volumeName="kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086029    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086042    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ce3e873-bfb3-4ae8-a487-6875c50aedc1" volumeName="kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086069    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e51ac73-92e8-48e1-a0ef-5ba865824e80" volumeName="kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086082    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086094    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086106    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51" volumeName="kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086120    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c19a307-d372-4008-abfa-de10f66837c1" volumeName="kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086131    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85fec599-5ad3-4971-a4ce-15f46736d55a" volumeName="kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086144    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51" volumeName="kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086158    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422" volumeName="kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086169    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4c98799-681b-46ea-8dfd-1081c6ecbd34" volumeName="kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086183    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086196    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e51ac73-92e8-48e1-a0ef-5ba865824e80" volumeName="kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086208    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c19a307-d372-4008-abfa-de10f66837c1" volumeName="kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086219    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01c476b7-f6d3-4ca0-bda3-2730fe09e1db" volumeName="kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086231    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="252c4068-aec5-4b0e-bab8-e836652aac9a" volumeName="kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086243    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="444c4868-604d-4d77-8686-d42468026f4a" volumeName="kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086255    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="658c1529-f42f-4f3d-9798-cff3600c2772" volumeName="kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086267    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="869e6098-8b18-4a7c-baa5-f4e2db8f5a97" volumeName="kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086279    5446 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af2197b8-f824-455b-8229-555a994abbac" volumeName="kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert" seLinuxMountContext=""
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086291    5446 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:27:14.093180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.086299    5446 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:27:14.110992 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.110963    5446 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:27:14.112358 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.112333    5446 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:27:14.112358 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.112359    5446 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:27:14.112461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.112380    5446 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:27:14.112461 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.112419    5446 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:27:14.144433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144378    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="8de0983e025ebf7793e486d9ace7149b34872bd98916d0cc516d98f591d7e231" exitCode=0
Oct 30 20:27:14.144433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144425    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="55aa3697303822931dcac7a02def2402cd1e2e046e07b3122ae83344d6cb0ca2" exitCode=0
Oct 30 20:27:14.144433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144435    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="b390584b4f8c511059f8715c74582331b4604d6a43d2ca99e50f0dcf30d9119e" exitCode=0
Oct 30 20:27:14.144604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144445    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="9847dde0cfe3ac68a7da6ed6951d5f7c12c2fbe20d3e946813d2e17a2f8e7eac" exitCode=0
Oct 30 20:27:14.144604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144475    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="62d608d0e1d02447afc2a6184dcc792c894a3c38a2d947128e7f39e44a0dcff0" exitCode=0
Oct 30 20:27:14.144604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.144483    5446 generic.go:356] "Generic (PLEG): container finished" podID="4c19a307-d372-4008-abfa-de10f66837c1" containerID="e558152c3ad0891bfdc5f72a99e45593903be6d4c9cf28589f898c21b3946b10" exitCode=0
Oct 30 20:27:14.152472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.152443    5446 generic.go:356] "Generic (PLEG): container finished" podID="d6d696aa218dabae4ecafea3cbd5237b" containerID="43fe533aa3e0460d97a403c917b55ab5cb3667a99891a579763322ee128e0c25" exitCode=0
Oct 30 20:27:14.158236 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.158214    5446 generic.go:356] "Generic (PLEG): container finished" podID="85fec599-5ad3-4971-a4ce-15f46736d55a" containerID="1ea4a265448fce744beee5d3062d475f09369018174dfbb2e254619b0be73981" exitCode=0
Oct 30 20:27:14.182571 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.182549    5446 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:27:14.187454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.187437    5446 manager.go:324] Recovery completed
Oct 30 20:27:14.206437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.206418    5446 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:27:14.208184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.208141    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:27:14.208184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.208168    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:27:14.208184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.208178    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:27:14.210722 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210702    5446 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:27:14.210722 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210717    5446 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:27:14.210832 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210720    5446 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:27:14.210832 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210820    5446 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:27:14.210962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210948    5446 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:27:14.210995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210962    5446 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:27:14.210995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210978    5446 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:27:14.210995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210983    5446 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:27:14.210995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210988    5446 policy_none.go:50] "Start"
Oct 30 20:27:14.211104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.210997    5446 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:27:14.211104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211006    5446 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:27:14.211155 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211124    5446 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:27:14.211155 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211130    5446 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:27:14.211155 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211136    5446 policy_none.go:44] "Start"
Oct 30 20:27:14.211514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211500    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:27:14.211562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211528    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:27:14.211562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.211541    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:27:14.212527 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.212513    5446 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 20:27:14.215433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.215407    5446 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:27:14.219162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219150    5446 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:27:14.219247 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.219177    5446 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:27:14.219247 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219186    5446 server.go:87] "Starting device plugin registration server"
Oct 30 20:27:14.219575 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219562    5446 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:27:14.219614 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219578    5446 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:27:14.219700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219677    5446 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:27:14.219844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219781    5446 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:27:14.219844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219844    5446 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:27:14.219972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219851    5446 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:27:14.220074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.219989    5446 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:27:14.219831214Z","UUID":"96aec75c-0d13-4325-adb6-01e522f969c8","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:27:14.221345 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.221316    5446 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:27:14.221345 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.221340    5446 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:27:14.222880 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.222861    5446 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:27:14.222987 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.222903    5446 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-188.us-west-1.compute.internal\" not found"
Oct 30 20:27:14.278781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.278759    5446 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:27:14.280104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.280076    5446 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:27:14.280178 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.280141    5446 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:27:14.280241 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.280185    5446 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:27:14.320553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.320531    5446 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:27:14.321372 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.321354    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:27:14.321440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.321382    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:27:14.321440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.321393    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:27:14.321440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.321429    5446 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.377331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.377311    5446 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:27:14.412647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.412597    5446 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"]
Oct 30 20:27:14.413231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413188    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"ee272d910da8698a9f404977ca9d2f88","Type":"ContainerStarted","Data":"8528a3dc550c1f4211a7ad3fcb0d700b5704fdcf6dfb0c92db66cb5ad2e33d83"}
Oct 30 20:27:14.413312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413241    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"ee272d910da8698a9f404977ca9d2f88","Type":"ContainerStarted","Data":"b959619c4e79e496edbd60b6fb3ebe9d28b67f8a05b986988714b9f298a127c4"}
Oct 30 20:27:14.413312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413249    5446 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.413312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413290    5446 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.413312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413302    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerStarted","Data":"d825ec9583eb59bf45d853c35a430f3544141f21ad8b7a2df69f901ff91dd215"}
Oct 30 20:27:14.413468 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413316    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerDied","Data":"43fe533aa3e0460d97a403c917b55ab5cb3667a99891a579763322ee128e0c25"}
Oct 30 20:27:14.413468 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.413328    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal" event={"ID":"d6d696aa218dabae4ecafea3cbd5237b","Type":"ContainerStarted","Data":"a396ef47f80bbec21986287c2482a0795f6dec238fba431a3d25079c4c90097b"}
Oct 30 20:27:14.433098 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.433075    5446 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.433162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.433128    5446 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.433590 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.433573    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 20:27:14.433647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.433600    5446 setters.go:546] "Node became not ready" node="ip-10-0-135-188.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T20:27:14Z","lastTransitionTime":"2026-10-30T20:27:14Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 20:27:14.480091 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.480040    5446 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:27:14.480091 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.480082    5446 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.481254 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.481239    5446 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:27:14.481304 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:14.481274    5446 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.488447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.488429    5446 nodeinfomanager.go:471] existing CSINode "ip-10-0-135-188.us-west-1.compute.internal" is owned by different node (oldNodeID="df570179-4d58-4926-9ef7-b5412428475b", newNodeID=""), cleaning up...
Oct 30 20:27:14.579975 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.579944    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.580064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.580008    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.580064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.580039    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681109    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681138    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681163    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681210    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee272d910da8698a9f404977ca9d2f88-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"ee272d910da8698a9f404977ca9d2f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681227    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:14.681310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:14.681210    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d696aa218dabae4ecafea3cbd5237b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" (UID: \"d6d696aa218dabae4ecafea3cbd5237b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:15.068174 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.068148    5446 apiserver.go:52] "Watching apiserver"
Oct 30 20:27:15.172020 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.171984    5446 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:27:15.172597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.172574    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7zntm","openshift-multus/network-metrics-daemon-s48cm","openshift-monitoring/metrics-server-7f79df684-rfrnc","openshift-image-registry/node-ca-s76jv","openshift-multus/multus-additional-cni-plugins-ztzdn","openshift-multus/multus-bcdjh","openshift-ovn-kubernetes/ovnkube-node-vgqxd","openshift-network-operator/iptables-alerter-r7pfv","openshift-monitoring/monitoring-plugin-77f4f76594-92nqc","kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal","openshift-ingress-canary/ingress-canary-xchfk","openshift-monitoring/telemeter-client-674f9d7465-lpx8q","openshift-monitoring/node-exporter-5xvsh","kube-system/global-pull-secret-syncer-tn2wd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc","openshift-cluster-node-tuning-operator/tuned-gnlbf","openshift-dns/node-resolver-dnm5p","openshift-dns/dns-default-jq2bz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal","kube-system/konnectivity-agent-mkf8g","openshift-monitoring/thanos-querier-595768c758-7mcq9","openshift-insights/insights-runtime-extractor-x8rwl","openshift-network-diagnostics/network-check-target-b59b5"]
Oct 30 20:27:15.175636 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.175612    5446 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:15.176258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.176237    5446 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:15.183491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183464    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.183582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183504    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.183582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183565    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.183705 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183599    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.183705 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183658    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.183798 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183718    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.183846 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183792    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:15.183888 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183869    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.183947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.183895    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvjg\" (UniqueName: \"kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:27:15.184080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184065    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.184110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184091    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184198    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184238    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.184302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184265    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:27:15.184302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184290    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.184446 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184429    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zcj\" (UniqueName: \"kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.184515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184494    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184589 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184571    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184606    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:27:15.184647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184637    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.184719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184662    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184696    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-etc-tuned\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184738    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184751    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-data-volume\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.184788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184768    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.184911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184817    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcshw\" (UniqueName: \"kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.184911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.184880    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:27:15.228027 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228004    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.228136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228094    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.228136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228119    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.228233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228122    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.228233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228218    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.228233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228226    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.228371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228246    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:27:15.228371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228270    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.228371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.228321    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.231430 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.231411    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.234671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.234657    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/658c1529-f42f-4f3d-9798-cff3600c2772-serviceca\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.238740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.238724    5446 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:27:15.238809 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.238741    5446 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:27:15.238809 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:15.238765    5446 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:15.238809 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:15.238781    5446 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.us-west-1.compute.internal"
Oct 30 20:27:15.260221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260201    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmclr\""
Oct 30 20:27:15.260221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260213    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-cnj9l\""
Oct 30 20:27:15.260330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260216    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ld6lr\""
Oct 30 20:27:15.260404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260393    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-52gtb\""
Oct 30 20:27:15.260435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260402    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wczr5\""
Oct 30 20:27:15.260462 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260438    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mkv2p\""
Oct 30 20:27:15.260462 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260447    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:27:15.260540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260529    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:27:15.260617 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260607    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wdmm\""
Oct 30 20:27:15.260711 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.260700    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47trg\""
Oct 30 20:27:15.265643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.265630    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a2d959-f0ce-422a-8132-74000b5383a0-agent-certs\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:27:15.277812 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.277792    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bx2zg\""
Oct 30 20:27:15.277935 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.277847    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:27:15.277984 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.277961    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:27:15.278042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278027    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:27:15.278088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278059    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:27:15.278164 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278151    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:27:15.278199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278157    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:27:15.278297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278284    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:27:15.278331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278294    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:27:15.278331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278302    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:27:15.278388 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278378    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:27:15.278454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278441    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:27:15.278704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278691    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:27:15.278756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278704    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gvqs4\""
Oct 30 20:27:15.278756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278695    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:27:15.278756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278719    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 20:27:15.278756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278743    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b99890thc43p4\""
Oct 30 20:27:15.278985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278761    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l9s5p\""
Oct 30 20:27:15.278985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278771    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwr4g\""
Oct 30 20:27:15.278985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.278775    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:27:15.279106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279051    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:27:15.279106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279063    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:27:15.279184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279114    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwgrd\""
Oct 30 20:27:15.279184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279142    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qn48m\""
Oct 30 20:27:15.279184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279116    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qpbct\""
Oct 30 20:27:15.279184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279115    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:27:15.279384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279192    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:27:15.279384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279256    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78mnk\""
Oct 30 20:27:15.279384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279352    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fngvs\""
Oct 30 20:27:15.279548 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279430    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tf8n6fqig7s7\""
Oct 30 20:27:15.279548 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279506    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bpqv7\""
Oct 30 20:27:15.279644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279587    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c8jj7\""
Oct 30 20:27:15.279644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279595    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-bxjhb\""
Oct 30 20:27:15.279644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279605    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:27:15.279766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279647    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 20:27:15.279766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279717    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:27:15.279828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.279803    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5tplx\""
Oct 30 20:27:15.280250 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.280233    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcshw\" (UniqueName: \"kubernetes.io/projected/658c1529-f42f-4f3d-9798-cff3600c2772-kube-api-access-bcshw\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.280337 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.280322    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7cr\" (UniqueName: \"kubernetes.io/projected/58a9d910-0c75-4701-8745-01683f4ad8da-kube-api-access-jj7cr\") pod \"network-check-target-b59b5\" (UID: \"58a9d910-0c75-4701-8745-01683f4ad8da\") " pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:15.283273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.283259    5446 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:27:15.284533 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.284515    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.286899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.286877    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af2197b8-f824-455b-8229-555a994abbac-cert\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:27:15.286899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.286902    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.287071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.286957    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.287071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.286980    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.287071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287003    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.287071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287028    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.287071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287068    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287139    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287168    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-modprobe-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287175    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287217    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287274    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.287309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287297    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-tmp\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287311    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287331    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287337    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/658c1529-f42f-4f3d-9798-cff3600c2772-host\") pod \"node-ca-s76jv\" (UID: \"658c1529-f42f-4f3d-9798-cff3600c2772\") " pod="openshift-image-registry/node-ca-s76jv"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287357    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287418    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287425    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-var-lib-kubelet\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287446    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287463    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287489    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287499    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-conf\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287511    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.287565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287551    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287603    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287642    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287711    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lgl\" (UniqueName: \"kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287731    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287796    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287834    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287891    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287952    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.287985    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288010    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288028    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288045    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.288071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288067    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4hl\" (UniqueName: \"kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288091    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288114    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn57\" (UniqueName: \"kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288139    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288176    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288305    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288309    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-client-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288347    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.288417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288414    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288432    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288475    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288497    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288515    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288532    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288554    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngg4\" (UniqueName: \"kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288570    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-sys\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.288623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288598    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288625    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288651    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288674    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgtg\" (UniqueName: \"kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288701    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288627    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysctl-d\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288747    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288784    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-tls\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288802    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-secret-telemeter-client\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.288861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288859    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288891    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288948    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288974    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.288998    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289008    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-textfile\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289025    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289028    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-audit-log\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289076    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289106    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289137    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289163    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-grpc-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289194    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-systemd\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289209    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.289253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289166    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289513    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/252c4068-aec5-4b0e-bab8-e836652aac9a-federate-client-tls\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289541    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289593    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289653    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289698    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjfgg\" (UniqueName: \"kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289735    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289766    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289796    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.289836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289829    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.290240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289858    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-648mr\" (UniqueName: \"kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.290240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289869    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/39c50552-39f0-4be4-9d70-ffade02c476f-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.290240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289888    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.290240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.289983    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.290240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290207    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-client-certs\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.290466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290274    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7ch\" (UniqueName: \"kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.290466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290313    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.290466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290348    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dtn\" (UniqueName: \"kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.290466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290377    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.290466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290451    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-tls\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290500    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290532    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290561    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290596    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290637    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290821    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tppgj\" (UniqueName: \"kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290855    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290880    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-tmp-dir\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290898    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.290966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.290944    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291100    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9pxd\" (UniqueName: \"kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291134    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291151    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-crio-socket\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291173    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291206    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291236    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291265    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291366    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.291402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291399    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291424    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291453    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291482    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291513    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291535    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291565    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291597    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291611    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-host\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291628    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.291766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291661    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291792    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291826    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291852    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291883    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ggdj\" (UniqueName: \"kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291936    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.291970    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292002    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgl9v\" (UniqueName: \"kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292035    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvr6\" (UniqueName: \"kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292065    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292094    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292125    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292156    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.292195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292180    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292213    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdl7j\" (UniqueName: \"kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292244    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292275    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292311    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292339    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292369    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292401    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292602    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.292775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292633    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.293193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.292897    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-metrics-tls\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.293272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293252    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-lib-modules\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.293476 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293454    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-run\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.293534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293476    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-secret-metrics-server-tls\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.293585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293568    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125b89e-655d-488e-a4c5-96d870660ccb-tmp\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.293642 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293580    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-kubernetes\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.293705 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293676    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:15.293779 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293759    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.293826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293776    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125b89e-655d-488e-a4c5-96d870660ccb-etc-sysconfig\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.293872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.293844    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.294169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.294146    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4c98799-681b-46ea-8dfd-1081c6ecbd34-metrics-certs\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:15.294299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.294235    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-original-pull-secret\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.294855 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.294831    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-tmp-dir\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.294855 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.294850    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovn-node-metrics-cert\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.329030 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.328972    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.329216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329201    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:27:15.329280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329249    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:27:15.329280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329247    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.329359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329287    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.329359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329304    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:27:15.329511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329499    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:27:15.329616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329602    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:27:15.329676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329618    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:27:15.329676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329622    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.329676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329670    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:27:15.329797 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329715    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:27:15.329797 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329728    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.329885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329815    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.329885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329825    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.329885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329868    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:27:15.330034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329892    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.330034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329901    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:27:15.330034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329908    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.330034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329934    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.330034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.329946    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.330204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330108    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:27:15.330204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330108    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:27:15.330288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330216    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-cni-binary-copy\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.330288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330244    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:27:15.330288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330245    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:27:15.330454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330413    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:27:15.330454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330440    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:27:15.330627 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330588    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:27:15.330697 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330655    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvjg\" (UniqueName: \"kubernetes.io/projected/af2197b8-f824-455b-8229-555a994abbac-kube-api-access-4jvjg\") pod \"ingress-canary-xchfk\" (UID: \"af2197b8-f824-455b-8229-555a994abbac\") " pod="openshift-ingress-canary/ingress-canary-xchfk"
Oct 30 20:27:15.330697 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330683    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zcj\" (UniqueName: \"kubernetes.io/projected/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-api-access-v8zcj\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.330808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330789    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:27:15.330866 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.330838    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:27:15.331839 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.331825    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.334083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334061    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-serving-certs-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.334146 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334124    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-env-overrides\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.334146 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334136    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e7f593f-c940-495e-8c54-bd999ee243d8-iptables-alerter-script\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.334230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334144    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-config-volume\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.334230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334174    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/444c4868-604d-4d77-8686-d42468026f4a-multus-daemon-config\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.334291 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334234    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-metrics-server-audit-profiles\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.334291 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334256    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-metrics-client-ca\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.334291 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.334281    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8rwl\" (UID: \"a5f8c3cf-76c6-4abb-bd8f-28ab2a0fa422\") " pod="openshift-insights/insights-runtime-extractor-x8rwl"
Oct 30 20:27:15.335435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.335421    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.335435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.335431    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a2d959-f0ce-422a-8132-74000b5383a0-konnectivity-ca\") pod \"konnectivity-agent-mkf8g\" (UID: \"03a2d959-f0ce-422a-8132-74000b5383a0\") " pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:27:15.338684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.338670    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-metrics-client-ca\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.338756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.338743    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.338819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.338798    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-metrics-client-ca\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.338865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.338850    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39c50552-39f0-4be4-9d70-ffade02c476f-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.340055 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.340033    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.340110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.340054    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-script-lib\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.340110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.340039    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c19a307-d372-4008-abfa-de10f66837c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.340110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.340079    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e51ac73-92e8-48e1-a0ef-5ba865824e80-ovnkube-config\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.340210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.340126    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252c4068-aec5-4b0e-bab8-e836652aac9a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.344318 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.344303    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lgl\" (UniqueName: \"kubernetes.io/projected/869e6098-8b18-4a7c-baa5-f4e2db8f5a97-kube-api-access-44lgl\") pod \"thanos-querier-595768c758-7mcq9\" (UID: \"869e6098-8b18-4a7c-baa5-f4e2db8f5a97\") " pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:15.345763 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.345742    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psn57\" (UniqueName: \"kubernetes.io/projected/2e7f593f-c940-495e-8c54-bd999ee243d8-kube-api-access-psn57\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.345853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.345762    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-648mr\" (UniqueName: \"kubernetes.io/projected/85fec599-5ad3-4971-a4ce-15f46736d55a-kube-api-access-648mr\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.345943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.345906    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngg4\" (UniqueName: \"kubernetes.io/projected/39c50552-39f0-4be4-9d70-ffade02c476f-kube-api-access-mngg4\") pod \"prometheus-operator-9cd89b74c-7zntm\" (UID: \"39c50552-39f0-4be4-9d70-ffade02c476f\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7zntm"
Oct 30 20:27:15.346300 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.346284    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgtg\" (UniqueName: \"kubernetes.io/projected/a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51-kube-api-access-fvgtg\") pod \"dns-default-jq2bz\" (UID: \"a5dd0f77-38e1-4ff9-b1a7-f5a3421efa51\") " pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:15.346905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.346884    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjfgg\" (UniqueName: \"kubernetes.io/projected/4c19a307-d372-4008-abfa-de10f66837c1-kube-api-access-xjfgg\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.347142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.347122    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dtn\" (UniqueName: \"kubernetes.io/projected/3e51ac73-92e8-48e1-a0ef-5ba865824e80-kube-api-access-g6dtn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.347242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.347126    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4hl\" (UniqueName: \"kubernetes.io/projected/01c476b7-f6d3-4ca0-bda3-2730fe09e1db-kube-api-access-qv4hl\") pod \"metrics-server-7f79df684-rfrnc\" (UID: \"01c476b7-f6d3-4ca0-bda3-2730fe09e1db\") " pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:15.347302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.347241    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7ch\" (UniqueName: \"kubernetes.io/projected/603efcb0-0cdc-447b-892a-fc99c798030a-kube-api-access-wf7ch\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.351803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.351786    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tppgj\" (UniqueName: \"kubernetes.io/projected/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-kube-api-access-tppgj\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.352064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.352050    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ggdj\" (UniqueName: \"kubernetes.io/projected/252c4068-aec5-4b0e-bab8-e836652aac9a-kube-api-access-2ggdj\") pod \"telemeter-client-674f9d7465-lpx8q\" (UID: \"252c4068-aec5-4b0e-bab8-e836652aac9a\") " pod="openshift-monitoring/telemeter-client-674f9d7465-lpx8q"
Oct 30 20:27:15.353749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.353732    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdl7j\" (UniqueName: \"kubernetes.io/projected/b125b89e-655d-488e-a4c5-96d870660ccb-kube-api-access-pdl7j\") pod \"tuned-gnlbf\" (UID: \"b125b89e-655d-488e-a4c5-96d870660ccb\") " pod="openshift-cluster-node-tuning-operator/tuned-gnlbf"
Oct 30 20:27:15.353811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.353792    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgl9v\" (UniqueName: \"kubernetes.io/projected/cf0ec03d-f2fb-449d-808b-a22d38de3a1c-kube-api-access-dgl9v\") pod \"monitoring-plugin-77f4f76594-92nqc\" (UID: \"cf0ec03d-f2fb-449d-808b-a22d38de3a1c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:15.353889 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.353829    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvr6\" (UniqueName: \"kubernetes.io/projected/444c4868-604d-4d77-8686-d42468026f4a-kube-api-access-fwvr6\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.353962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.353947    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9pxd\" (UniqueName: \"kubernetes.io/projected/e4c98799-681b-46ea-8dfd-1081c6ecbd34-kube-api-access-d9pxd\") pod \"network-metrics-daemon-s48cm\" (UID: \"e4c98799-681b-46ea-8dfd-1081c6ecbd34\") " pod="openshift-multus/network-metrics-daemon-s48cm"
Oct 30 20:27:15.393742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393722    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393747    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393764    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.393808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393780    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.393808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393783    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-conf-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393794    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393820    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393822    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-netd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393849    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393858    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-etc-kubernetes\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393863    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-cnibin\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393870    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-multus\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393892    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393937    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393946    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-system-cni-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393953    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.393973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393969    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.393983    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394006    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394018    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-node-exporter-wtmp\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394038    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-registration-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394044    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-cni-bin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394048    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-netns\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394048    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-socket-dir-parent\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394068    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394084    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394100    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394110    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-kubelet\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394117    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394131    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394142    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-cnibin\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394144    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394153    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-sys-fs\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394170    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ce3e873-bfb3-4ae8-a487-6875c50aedc1-hosts-file\") pod \"node-resolver-dnm5p\" (UID: \"1ce3e873-bfb3-4ae8-a487-6875c50aedc1\") " pod="openshift-dns/node-resolver-dnm5p"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394162    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394187    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-cni-bin\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394198    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-slash\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394190    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-multus-certs\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394208    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394237    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394244    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394255    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394266    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394282    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394300    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-var-lib-kubelet\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394310    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394330    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394358    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-log-socket\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394369    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c19a307-d372-4008-abfa-de10f66837c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ztzdn\" (UID: \"4c19a307-d372-4008-abfa-de10f66837c1\") " pod="openshift-multus/multus-additional-cni-plugins-ztzdn"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394361    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394379    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-ovn\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394404    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394432    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394441    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-node-log\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394407    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-root\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394454    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394481    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394496    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-socket-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394502    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394532    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394549    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-system-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394555    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.394543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394576    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-device-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394574    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394580    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-run-systemd\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394592    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-etc-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394600    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394620    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-host-run-netns\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394624    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394620    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394579    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-multus-cni-dir\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394661    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e7f593f-c940-495e-8c54-bd999ee243d8-host-slash\") pod \"iptables-alerter-r7pfv\" (UID: \"2e7f593f-c940-495e-8c54-bd999ee243d8\") " pod="openshift-network-operator/iptables-alerter-r7pfv"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394684    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394723    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-var-lib-openvswitch\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394730    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394754    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394769    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394791    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-host-run-k8s-cni-cncf-io\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394800    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/444c4868-604d-4d77-8686-d42468026f4a-hostroot\") pod \"multus-bcdjh\" (UID: \"444c4868-604d-4d77-8686-d42468026f4a\") " pod="openshift-multus/multus-bcdjh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394808    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85fec599-5ad3-4971-a4ce-15f46736d55a-sys\") pod \"node-exporter-5xvsh\" (UID: \"85fec599-5ad3-4971-a4ce-15f46736d55a\") " pod="openshift-monitoring/node-exporter-5xvsh"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394812    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394829    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394842    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394855    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394870    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/603efcb0-0cdc-447b-892a-fc99c798030a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf4sc\" (UID: \"603efcb0-0cdc-447b-892a-fc99c798030a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf4sc"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394894    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e51ac73-92e8-48e1-a0ef-5ba865824e80-systemd-units\") pod \"ovnkube-node-vgqxd\" (UID: \"3e51ac73-92e8-48e1-a0ef-5ba865824e80\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394905    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-dbus\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:15.395854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:15.394931    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6215d32-ffbd-4fbf-a13d-3df9527fcd53-kubelet-config\") pod \"global-pull-secret-syncer-tn2wd\" (UID: \"c6215d32-ffbd-4fbf-a13d-3df9527fcd53\") " pod="kube-system/global-pull-secret-syncer-tn2wd"
Oct 30 20:27:16.359142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:16.359115    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:16.906715 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:16.906681    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:16.912308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:16.912257    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-595768c758-7mcq9"
Oct 30 20:27:17.105179 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:17.105147    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:17.327552 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:17.327470    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jq2bz"
Oct 30 20:27:19.260836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:19.260805    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:19.261215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:19.261046    5446 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:27:19.514583 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:19.514505    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:27:21.648990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:21.648959    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:23.940721 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:23.940637    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:23.945449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:23.945425    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-92nqc"
Oct 30 20:27:24.585712 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:24.585679    5446 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-188.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:27:34.542932 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:34.542884    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:37.110983 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:37.110952    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:37.114626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:37.114598    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f79df684-rfrnc"
Oct 30 20:27:38.254520 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:38.254488    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgqxd"
Oct 30 20:27:39.874956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.874900    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:27:39.883900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.883877    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.937870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.937842    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:27:39.937870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.937854    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:27:39.938039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.937844    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:27:39.938039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.937866    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:27:39.965263 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965240    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965274    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-kube-api-access-d2p4b\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965294    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965349    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965377    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965484    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965511    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965653 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965545    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965711 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965653    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965705    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-web-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965810 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965762    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965818    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.965878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.965838    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-out\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:39.986342 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:39.986319    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:27:40.036841 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.036810    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:27:40.037096 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.037073    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:27:40.037185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.037144    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:27:40.037185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.037158    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:27:40.037273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.037181    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nnmlc\""
Oct 30 20:27:40.037900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.037886    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:27:40.066624 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066596    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066631    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066655    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066715    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066756    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-web-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066788    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066817    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.066876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066845    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-out\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066877    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066909    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-kube-api-access-d2p4b\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066968    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.066994    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.067019    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.067049    5446 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:27:40.067103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.067059    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.067994 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.067714    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.068490 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.068467    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.070149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.070095    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.070611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.070552    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.070789 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.070773    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071002    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-out\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071100    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071203    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071300 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071283    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071356 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071331    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.071959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.071941    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-web-config\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.126580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.126526    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/dc44cbbe-c13a-47a3-a833-354a3af5f8bc-kube-api-access-d2p4b\") pod \"alertmanager-main-0\" (UID: \"dc44cbbe-c13a-47a3-a833-354a3af5f8bc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.206323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.206300    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:27:40.685264 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:40.685236    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:27:40.691129 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:27:40.691091    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc44cbbe_c13a_47a3_a833_354a3af5f8bc.slice/crio-56ff1a669e5be0c36b1d3d932ac5309b416fc48e55e1f99112909b2b0ba2cd1d WatchSource:0}: Error finding container 56ff1a669e5be0c36b1d3d932ac5309b416fc48e55e1f99112909b2b0ba2cd1d: Status 404 returned error can't find the container with id 56ff1a669e5be0c36b1d3d932ac5309b416fc48e55e1f99112909b2b0ba2cd1d
Oct 30 20:27:41.266042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:41.266006    5446 generic.go:356] "Generic (PLEG): container finished" podID="dc44cbbe-c13a-47a3-a833-354a3af5f8bc" containerID="454f2facf039c703b78953eaf7eeb5855ff34eccaf8bb10536438b00d3ca2388" exitCode=0
Oct 30 20:27:41.266504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:41.266102    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerDied","Data":"454f2facf039c703b78953eaf7eeb5855ff34eccaf8bb10536438b00d3ca2388"}
Oct 30 20:27:41.266504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:41.266183    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"56ff1a669e5be0c36b1d3d932ac5309b416fc48e55e1f99112909b2b0ba2cd1d"}
Oct 30 20:27:41.267351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:41.267336    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:27:41.651516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:41.651487    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b59b5"
Oct 30 20:27:44.105049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.105021    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkf8g"
Oct 30 20:27:44.278747 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278674    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"7927b21a416b9b7dc54ea411194344e49067bf4a73e8c19a6c120d8f729d1cea"}
Oct 30 20:27:44.278747 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278741    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"f839673acd352590bda594e631cabdbb058f8b035af22e5804badece19807890"}
Oct 30 20:27:44.278905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278770    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"a8c7864ca11c3ecb4b48562bb39d86368045e1bc8de2461beb9a3085a5535533"}
Oct 30 20:27:44.278905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278799    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"aa6a52f46e3aef7950ec7901a495fcb6797ae5aafcedcc7a1b35c07780fa3c0d"}
Oct 30 20:27:44.278905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278821    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"0636c97c845f48e7d3737c4dbaf7a9cec2fd8f0557f104021ac5c9ef76c64edb"}
Oct 30 20:27:44.278905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.278851    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc44cbbe-c13a-47a3-a833-354a3af5f8bc","Type":"ContainerStarted","Data":"af639395b9d1d04e49919795cb4aeb1d42f0e927ea965558cf0238b458994366"}
Oct 30 20:27:44.503828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:27:44.503784    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.327859698 podStartE2EDuration="5.503772439s" totalImagesPullingTime="2.165518695s" totalInitContainerRuntime="10.394046ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:27:44.454043521 +0000 UTC m=+30.446046663" watchObservedRunningTime="2026-10-30 20:27:44.503772439 +0000 UTC m=+30.495775560"
Oct 30 20:27:49.513984 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:27:49.513938    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:28:19.517246 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:28:19.517203    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:28:49.514483 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:28:49.514449    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:29:19.514244 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:29:19.514208    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:29:49.515174 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:29:49.515136    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:30:03.700496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.700464    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"]
Oct 30 20:30:03.702525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.702504    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.804741 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.804703    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:30:03.804957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.804772    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:30:03.804957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.804860    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-mvprc\""
Oct 30 20:30:03.805553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.805534    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"]
Oct 30 20:30:03.835459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.835428    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.835614 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.835477    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v92lw\" (UniqueName: \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.835614 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.835497    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.868382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.868355    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"]
Oct 30 20:30:03.870487 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.870472    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:03.923998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.923972    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-jk2md\""
Oct 30 20:30:03.928755 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.928728    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"]
Oct 30 20:30:03.936237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.936212    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.936364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.936259    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v92lw\" (UniqueName: \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.936364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.936281    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.936700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.936682    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.936782 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.936765    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:03.988806 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.988752    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:30:03.990695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.990665    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:03.997964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:03.997944    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v92lw\" (UniqueName: \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:04.013818 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.013798    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:04.037454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.037428    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.037560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.037479    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssmk\" (UniqueName: \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.037610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.037569    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.044540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.044517    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 20:30:04.044640 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.044560    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jmh9r\""
Oct 30 20:30:04.044640 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.044589    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 20:30:04.044937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.044897    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 20:30:04.045551 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.045533    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:30:04.045620 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.045564    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:30:04.045620 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.045598    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:30:04.052634 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.052614    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:30:04.137901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.137869    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwvvw\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.137909    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.138064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.137987    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138054    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138102    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138121    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138139    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138217    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.138328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138312    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.138402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138327    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.138402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138344    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nssmk\" (UniqueName: \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.138465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.138455    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.195929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.195901    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nssmk\" (UniqueName: \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.238954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.238880    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwvvw\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.238954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.238931    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.239126 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.239004    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.239238 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.239215    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.239309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.239254    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.239309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.239292    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.239410 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.239326    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.240063 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.240040    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.241343 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.241317    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.241492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.241476    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.241492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.241487    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.242204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.242189    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.299081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.299046    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.300523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.300502    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwvvw\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\") pod \"istiod-openshift-gateway-7876bfcb74-bsrgf\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.306192 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.306173    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:04.390638 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.390615    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"]
Oct 30 20:30:04.393217 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:30:04.393190    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639f3f15_6caa_48b0_b8b3_299765bf78b9.slice/crio-f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b WatchSource:0}: Error finding container f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b: Status 404 returned error can't find the container with id f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b
Oct 30 20:30:04.482505 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.482478    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:04.678301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.678269    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:30:04.681329 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:30:04.681299    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab260e6e_b88c_4664_97de_cdb8f827b50a.slice/crio-9284c64c48ac1a09ffaf26d1c452d9227e70c61c968bc8cc3b3a90b0632ffd13 WatchSource:0}: Error finding container 9284c64c48ac1a09ffaf26d1c452d9227e70c61c968bc8cc3b3a90b0632ffd13: Status 404 returned error can't find the container with id 9284c64c48ac1a09ffaf26d1c452d9227e70c61c968bc8cc3b3a90b0632ffd13
Oct 30 20:30:04.755803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.755748    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc" event={"ID":"639f3f15-6caa-48b0-b8b3-299765bf78b9","Type":"ContainerStarted","Data":"f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b"}
Oct 30 20:30:04.756979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.756954    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" event={"ID":"ab260e6e-b88c-4664-97de-cdb8f827b50a","Type":"ContainerStarted","Data":"9284c64c48ac1a09ffaf26d1c452d9227e70c61c968bc8cc3b3a90b0632ffd13"}
Oct 30 20:30:04.852626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:04.852606    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"]
Oct 30 20:30:04.855298 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:30:04.855270    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e04dd1_bd78_4cec_9f95_35829a937202.slice/crio-4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676 WatchSource:0}: Error finding container 4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676: Status 404 returned error can't find the container with id 4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676
Oct 30 20:30:05.762954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:05.762888    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7" event={"ID":"b5e04dd1-bd78-4cec-9f95-35829a937202","Type":"ContainerStarted","Data":"4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676"}
Oct 30 20:30:10.367165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:10.367123    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:30:10.367531 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:10.367209    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:30:10.788594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:10.788501    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" event={"ID":"ab260e6e-b88c-4664-97de-cdb8f827b50a","Type":"ContainerStarted","Data":"2b84add62178d2d96fcc0d9b9cb87f3e32451c9ea7ecf3a9fb984a9a31aab4d8"}
Oct 30 20:30:10.788594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:10.788570    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:11.005552 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:11.005496    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" podStartSLOduration=2.322632531 podStartE2EDuration="8.005480939s" totalImagesPullingTime="5.682848408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:10.955125718 +0000 UTC m=+176.947128838" watchObservedRunningTime="2026-10-30 20:30:11.005480939 +0000 UTC m=+176.997484060"
Oct 30 20:30:11.794357 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:11.794279    5446 generic.go:356] "Generic (PLEG): container finished" podID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerID="f8a034f85b401da376079e3e0058281095dbb7e7ddb25a730db3c2d01b2484d0" exitCode=0
Oct 30 20:30:11.794826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:11.794393    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc" event={"ID":"639f3f15-6caa-48b0-b8b3-299765bf78b9","Type":"ContainerDied","Data":"f8a034f85b401da376079e3e0058281095dbb7e7ddb25a730db3c2d01b2484d0"}
Oct 30 20:30:11.796015 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:11.795989    5446 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-bsrgf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:30:11.796112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:11.796034    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:30:12.799632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:12.799599    5446 generic.go:356] "Generic (PLEG): container finished" podID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerID="8d998a630f3888b1d64f38ebdadbc21113a78a320363f74b1382003985e0bd8b" exitCode=0
Oct 30 20:30:12.800025 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:12.799688    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7" event={"ID":"b5e04dd1-bd78-4cec-9f95-35829a937202","Type":"ContainerDied","Data":"8d998a630f3888b1d64f38ebdadbc21113a78a320363f74b1382003985e0bd8b"}
Oct 30 20:30:14.795308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:14.795273    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:30:14.809689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:14.809661    5446 generic.go:356] "Generic (PLEG): container finished" podID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerID="e459702aafbfc0cc5f7bae054d149c405a56beb050b9247614500cacb18f84f5" exitCode=0
Oct 30 20:30:14.809831 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:14.809750    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7" event={"ID":"b5e04dd1-bd78-4cec-9f95-35829a937202","Type":"ContainerDied","Data":"e459702aafbfc0cc5f7bae054d149c405a56beb050b9247614500cacb18f84f5"}
Oct 30 20:30:15.816544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:15.816515    5446 generic.go:356] "Generic (PLEG): container finished" podID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerID="5b689dcb54a92388fa2cc1cf85e00c4f580e91e1b97b6d3e6c819000817cbab1" exitCode=0
Oct 30 20:30:15.817020 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:15.816589    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc" event={"ID":"639f3f15-6caa-48b0-b8b3-299765bf78b9","Type":"ContainerDied","Data":"5b689dcb54a92388fa2cc1cf85e00c4f580e91e1b97b6d3e6c819000817cbab1"}
Oct 30 20:30:19.521335 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:30:19.521297    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:30:22.848284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:22.848193    5446 generic.go:356] "Generic (PLEG): container finished" podID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerID="445aeaea44eaf607266c4f18fbcd3b14d6f4bfa75a3a354191c323ec65709317" exitCode=0
Oct 30 20:30:22.848705 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:22.848277    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7" event={"ID":"b5e04dd1-bd78-4cec-9f95-35829a937202","Type":"ContainerDied","Data":"445aeaea44eaf607266c4f18fbcd3b14d6f4bfa75a3a354191c323ec65709317"}
Oct 30 20:30:23.853779 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:23.853691    5446 generic.go:356] "Generic (PLEG): container finished" podID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerID="cf026e02c679f5fa45677e60150295236966fd6586311f7b5659bf2887c2c636" exitCode=0
Oct 30 20:30:23.854221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:23.853777    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc" event={"ID":"639f3f15-6caa-48b0-b8b3-299765bf78b9","Type":"ContainerDied","Data":"cf026e02c679f5fa45677e60150295236966fd6586311f7b5659bf2887c2c636"}
Oct 30 20:30:23.974447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:23.974424    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:24.011203 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.011181    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\") pod \"b5e04dd1-bd78-4cec-9f95-35829a937202\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") "
Oct 30 20:30:24.011281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.011222    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\" (UniqueName: \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\") pod \"b5e04dd1-bd78-4cec-9f95-35829a937202\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") "
Oct 30 20:30:24.011281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.011243    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\") pod \"b5e04dd1-bd78-4cec-9f95-35829a937202\" (UID: \"b5e04dd1-bd78-4cec-9f95-35829a937202\") "
Oct 30 20:30:24.011701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.011680    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle" pod "b5e04dd1-bd78-4cec-9f95-35829a937202" (UID: "b5e04dd1-bd78-4cec-9f95-35829a937202"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:30:24.013439 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.013415    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk" pod "b5e04dd1-bd78-4cec-9f95-35829a937202" (UID: "b5e04dd1-bd78-4cec-9f95-35829a937202"). InnerVolumeSpecName "kube-api-access-nssmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:24.015445 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.015424    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util" pod "b5e04dd1-bd78-4cec-9f95-35829a937202" (UID: "b5e04dd1-bd78-4cec-9f95-35829a937202"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:30:24.112698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.112678    5446 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-bundle\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:24.112698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.112700    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssmk\" (UniqueName: \"kubernetes.io/projected/b5e04dd1-bd78-4cec-9f95-35829a937202-kube-api-access-nssmk\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:24.112854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.112709    5446 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5e04dd1-bd78-4cec-9f95-35829a937202-util\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:24.858325 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.858298    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7"
Oct 30 20:30:24.858796 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.858333    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71r6kr7" event={"ID":"b5e04dd1-bd78-4cec-9f95-35829a937202","Type":"ContainerDied","Data":"4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676"}
Oct 30 20:30:24.858796 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.858395    5446 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4739ab865a3e3808e9a93c1f3ca7f0a2ef922be21d35d7e2cea3dbd9b49c1676"
Oct 30 20:30:24.976337 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:24.976316    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:25.020158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.020134    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\") pod \"639f3f15-6caa-48b0-b8b3-299765bf78b9\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") "
Oct 30 20:30:25.020260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.020170    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\") pod \"639f3f15-6caa-48b0-b8b3-299765bf78b9\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") "
Oct 30 20:30:25.020260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.020220    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\" (UniqueName: \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\") pod \"639f3f15-6caa-48b0-b8b3-299765bf78b9\" (UID: \"639f3f15-6caa-48b0-b8b3-299765bf78b9\") "
Oct 30 20:30:25.020560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.020531    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle" pod "639f3f15-6caa-48b0-b8b3-299765bf78b9" (UID: "639f3f15-6caa-48b0-b8b3-299765bf78b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:30:25.022283 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.022260    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw" pod "639f3f15-6caa-48b0-b8b3-299765bf78b9" (UID: "639f3f15-6caa-48b0-b8b3-299765bf78b9"). InnerVolumeSpecName "kube-api-access-v92lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:25.024326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.024307    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util" pod "639f3f15-6caa-48b0-b8b3-299765bf78b9" (UID: "639f3f15-6caa-48b0-b8b3-299765bf78b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:30:25.121186 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.121163    5446 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-bundle\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:25.121186 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.121185    5446 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/639f3f15-6caa-48b0-b8b3-299765bf78b9-util\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:25.121329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.121195    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v92lw\" (UniqueName: \"kubernetes.io/projected/639f3f15-6caa-48b0-b8b3-299765bf78b9-kube-api-access-v92lw\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:30:25.864137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.864109    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc"
Oct 30 20:30:25.864137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.864111    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644k5cdc" event={"ID":"639f3f15-6caa-48b0-b8b3-299765bf78b9","Type":"ContainerDied","Data":"f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b"}
Oct 30 20:30:25.864548 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:25.864158    5446 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f95e78c84758d49ca494ed25ea0843253b869504ce136824760112fd40b8686b"
Oct 30 20:30:43.624193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624155    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"]
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624568    5446 cpu_manager.go:414] "containerMap: removing container" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="pull"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624587    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="pull"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624619    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="pull"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624626    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="pull"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624645    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="util"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624652    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="util"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624663    5446 cpu_manager.go:414] "containerMap: removing container" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="util"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624671    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="util"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624681    5446 cpu_manager.go:414] "containerMap: removing container" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="extract"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624687    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="extract"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624709    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="extract"
Oct 30 20:30:43.624756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624716    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="extract"
Oct 30 20:30:43.625351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624781    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="639f3f15-6caa-48b0-b8b3-299765bf78b9" containerName="extract"
Oct 30 20:30:43.625351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.624795    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5e04dd1-bd78-4cec-9f95-35829a937202" containerName="extract"
Oct 30 20:30:43.628750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.628728    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.744743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.744714    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-manifests\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.744865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.744762    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-tmp\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.744865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.744796    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-metrics-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.744990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.744929    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.744990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.744985    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.745059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.745011    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbfj\" (UniqueName: \"kubernetes.io/projected/a5a71c56-ade1-4f52-9e89-ed22c43953db-kube-api-access-blbfj\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.758379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758356    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 20:30:43.758647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758628    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 20:30:43.758756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758739    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 20:30:43.758824 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758743    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 20:30:43.758824 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758786    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 20:30:43.758824 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.758811    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-jjpq2\""
Oct 30 20:30:43.764963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.764944    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"]
Oct 30 20:30:43.845323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845301    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbfj\" (UniqueName: \"kubernetes.io/projected/a5a71c56-ade1-4f52-9e89-ed22c43953db-kube-api-access-blbfj\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845336    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-manifests\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845359    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-tmp\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845386    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-metrics-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845424    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845640 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845463    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.845818 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.845798    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-manifests\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.847719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.847700    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5a71c56-ade1-4f52-9e89-ed22c43953db-tmp\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.848032 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.848011    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.848347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.848325    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.848429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.848390    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a71c56-ade1-4f52-9e89-ed22c43953db-metrics-cert\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.906305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.906254    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbfj\" (UniqueName: \"kubernetes.io/projected/a5a71c56-ade1-4f52-9e89-ed22c43953db-kube-api-access-blbfj\") pod \"opendatahub-operator-controller-manager-fdf79688b-xp8kd\" (UID: \"a5a71c56-ade1-4f52-9e89-ed22c43953db\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:43.941229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:43.941208    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:44.434381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:44.434358    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"]
Oct 30 20:30:44.436995 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:30:44.436970    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a71c56_ade1_4f52_9e89_ed22c43953db.slice/crio-e352fb122fe9e1a99490d1acf1d71398b14d007612be8cc46b11f1fd6fa1180d WatchSource:0}: Error finding container e352fb122fe9e1a99490d1acf1d71398b14d007612be8cc46b11f1fd6fa1180d: Status 404 returned error can't find the container with id e352fb122fe9e1a99490d1acf1d71398b14d007612be8cc46b11f1fd6fa1180d
Oct 30 20:30:44.932257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:44.932226    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd" event={"ID":"a5a71c56-ade1-4f52-9e89-ed22c43953db","Type":"ContainerStarted","Data":"e352fb122fe9e1a99490d1acf1d71398b14d007612be8cc46b11f1fd6fa1180d"}
Oct 30 20:30:48.950289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:48.950257    5446 generic.go:356] "Generic (PLEG): container finished" podID="a5a71c56-ade1-4f52-9e89-ed22c43953db" containerID="b1a9c89039558ea6350167123aa53f8d12b508027c169cfb429ce11c4d7cca0c" exitCode=0
Oct 30 20:30:48.950734 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:48.950340    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd" event={"ID":"a5a71c56-ade1-4f52-9e89-ed22c43953db","Type":"ContainerDied","Data":"b1a9c89039558ea6350167123aa53f8d12b508027c169cfb429ce11c4d7cca0c"}
Oct 30 20:30:49.513960 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:30:49.513910    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:30:49.956499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:49.956466    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd" event={"ID":"a5a71c56-ade1-4f52-9e89-ed22c43953db","Type":"ContainerStarted","Data":"682986a28a726ec5efa365a27c73491c8ea4b443b7dfb53ebc45cd3b0908234e"}
Oct 30 20:30:49.956991 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:49.956606    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:30:50.188871 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:30:50.188824    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd" podStartSLOduration=2.39443339 podStartE2EDuration="7.188811223s" totalImagesPullingTime="4.347853348s" totalInitContainerRuntime="446.524485ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:50.138993904 +0000 UTC m=+216.130997032" watchObservedRunningTime="2026-10-30 20:30:50.188811223 +0000 UTC m=+216.180814393"
Oct 30 20:31:00.962135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:00.962104    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fdf79688b-xp8kd"
Oct 30 20:31:17.360268 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.360236    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"]
Oct 30 20:31:17.362810 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.362795    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.417296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.417274    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 20:31:17.465399 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.465376    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ltg7l\""
Oct 30 20:31:17.465501 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.465416    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 20:31:17.467661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.467637    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"]
Oct 30 20:31:17.498137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.498112    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d639cc-b837-4d5b-b36c-438382d9db6a-tmp\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.498238 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.498146    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d639cc-b837-4d5b-b36c-438382d9db6a-tls-certs\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.498238 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.498169    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdw58\" (UniqueName: \"kubernetes.io/projected/52d639cc-b837-4d5b-b36c-438382d9db6a-kube-api-access-qdw58\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.599231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.599203    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d639cc-b837-4d5b-b36c-438382d9db6a-tmp\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.599336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.599235    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d639cc-b837-4d5b-b36c-438382d9db6a-tls-certs\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.599336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.599252    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdw58\" (UniqueName: \"kubernetes.io/projected/52d639cc-b837-4d5b-b36c-438382d9db6a-kube-api-access-qdw58\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.601632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.601603    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d639cc-b837-4d5b-b36c-438382d9db6a-tmp\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.601743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.601725    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d639cc-b837-4d5b-b36c-438382d9db6a-tls-certs\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.659847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.659821    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdw58\" (UniqueName: \"kubernetes.io/projected/52d639cc-b837-4d5b-b36c-438382d9db6a-kube-api-access-qdw58\") pod \"kube-auth-proxy-65fc6db558-p7csx\" (UID: \"52d639cc-b837-4d5b-b36c-438382d9db6a\") " pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:17.672762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:17.672742    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"
Oct 30 20:31:18.053968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:18.053843    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65fc6db558-p7csx"]
Oct 30 20:31:18.056395 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:31:18.056365    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d639cc_b837_4d5b_b36c_438382d9db6a.slice/crio-6a056b04e9d2f1319af01e4965d9873694917f979045eafa915227763eb239e7 WatchSource:0}: Error finding container 6a056b04e9d2f1319af01e4965d9873694917f979045eafa915227763eb239e7: Status 404 returned error can't find the container with id 6a056b04e9d2f1319af01e4965d9873694917f979045eafa915227763eb239e7
Oct 30 20:31:18.070174 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:18.070151    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx" event={"ID":"52d639cc-b837-4d5b-b36c-438382d9db6a","Type":"ContainerStarted","Data":"6a056b04e9d2f1319af01e4965d9873694917f979045eafa915227763eb239e7"}
Oct 30 20:31:19.030335 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.030300    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:31:19.032816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.032796    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.086491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.086467    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6tg6g\""
Oct 30 20:31:19.111040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.111009    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.111181 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.111074    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8v4\" (UniqueName: \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.135650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.135601    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:31:19.135650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.135601    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:31:19.135833 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.135630    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 20:31:19.136963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.136942    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:31:19.212266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.212240    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8v4\" (UniqueName: \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.212410 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.212306    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.213115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.213086    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.264793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.264766    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:31:19.272698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.272675    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8v4\" (UniqueName: \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\") pod \"limitador-limitador-74dfcfb894-vzgbr\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.344658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.344586    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:19.523721 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:31:19.523673    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:31:19.730452 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:19.730422    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:31:19.734194 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:31:19.734154    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2090987_8446_490c_abc2_16944285d75e.slice/crio-84ba022c269b4b47b62eac08a58f67292f63d8ace1f7ed8df5e5f0e15bf877a0 WatchSource:0}: Error finding container 84ba022c269b4b47b62eac08a58f67292f63d8ace1f7ed8df5e5f0e15bf877a0: Status 404 returned error can't find the container with id 84ba022c269b4b47b62eac08a58f67292f63d8ace1f7ed8df5e5f0e15bf877a0
Oct 30 20:31:20.079811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:20.079731    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" event={"ID":"d2090987-8446-490c-abc2-16944285d75e","Type":"ContainerStarted","Data":"84ba022c269b4b47b62eac08a58f67292f63d8ace1f7ed8df5e5f0e15bf877a0"}
Oct 30 20:31:22.088737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:22.088700    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx" event={"ID":"52d639cc-b837-4d5b-b36c-438382d9db6a","Type":"ContainerStarted","Data":"68075a918d8e699522fbc8c6d3fc7cef9f7e61d4bb2f0a940d59a46721dc9349"}
Oct 30 20:31:22.206835 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:22.206770    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65fc6db558-p7csx" podStartSLOduration=2.173928282 podStartE2EDuration="5.206752865s" totalImagesPullingTime="3.032824583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:31:22.205534641 +0000 UTC m=+248.197537767" watchObservedRunningTime="2026-10-30 20:31:22.206752865 +0000 UTC m=+248.198755993"
Oct 30 20:31:24.099092 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:24.099027    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" event={"ID":"d2090987-8446-490c-abc2-16944285d75e","Type":"ContainerStarted","Data":"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"}
Oct 30 20:31:24.099411 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:24.099139    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:24.215229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:24.215184    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" podStartSLOduration=2.147134863 podStartE2EDuration="6.215168255s" totalImagesPullingTime="4.068033392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:31:24.214280228 +0000 UTC m=+250.206283356" watchObservedRunningTime="2026-10-30 20:31:24.215168255 +0000 UTC m=+250.207171382"
Oct 30 20:31:35.104184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:35.104154    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:31:49.515694 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:31:49.515651    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:31:53.094320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.094229    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:31:53.097629 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.097604    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:31:53.153111 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.153081    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:31:53.187186 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.187139    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9nd\" (UniqueName: \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\") pod \"authorino-56c6c9ddd5-zlxs6\" (UID: \"4e150c6b-39ae-47e5-afd2-205d54bc8c63\") " pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:31:53.201334 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.201307    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ckfjh\""
Oct 30 20:31:53.288447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.288384    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9nd\" (UniqueName: \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\") pod \"authorino-56c6c9ddd5-zlxs6\" (UID: \"4e150c6b-39ae-47e5-afd2-205d54bc8c63\") " pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:31:53.346752 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.346683    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9nd\" (UniqueName: \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\") pod \"authorino-56c6c9ddd5-zlxs6\" (UID: \"4e150c6b-39ae-47e5-afd2-205d54bc8c63\") " pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:31:53.416495 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.416450    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:31:53.788043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:53.788012    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:31:53.791706 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:31:53.791669    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e150c6b_39ae_47e5_afd2_205d54bc8c63.slice/crio-9e830fc4881347bdc0cba75756f24dfd33b8c4308d72701b068c050c6d2de884 WatchSource:0}: Error finding container 9e830fc4881347bdc0cba75756f24dfd33b8c4308d72701b068c050c6d2de884: Status 404 returned error can't find the container with id 9e830fc4881347bdc0cba75756f24dfd33b8c4308d72701b068c050c6d2de884
Oct 30 20:31:54.215625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:54.215584    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" event={"ID":"4e150c6b-39ae-47e5-afd2-205d54bc8c63","Type":"ContainerStarted","Data":"9e830fc4881347bdc0cba75756f24dfd33b8c4308d72701b068c050c6d2de884"}
Oct 30 20:31:57.231496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:57.231458    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" event={"ID":"4e150c6b-39ae-47e5-afd2-205d54bc8c63","Type":"ContainerStarted","Data":"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"}
Oct 30 20:31:57.345712 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:31:57.345654    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" podStartSLOduration=1.767798132 podStartE2EDuration="4.345638409s" totalImagesPullingTime="2.577840277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:31:57.344674529 +0000 UTC m=+283.336677657" watchObservedRunningTime="2026-10-30 20:31:57.345638409 +0000 UTC m=+283.337641535"
Oct 30 20:32:04.970259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:04.970221    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:32:04.970693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:04.970501    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" podUID="d2090987-8446-490c-abc2-16944285d75e" containerName="limitador" containerID="cri-o://577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7" gracePeriod=30
Oct 30 20:32:05.103602 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.103558    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" podUID="d2090987-8446-490c-abc2-16944285d75e" containerName="limitador" probeResult="failure" output="Get \"http://10.133.0.20:8080/status\": dial tcp 10.133.0.20:8080: connect: connection refused"
Oct 30 20:32:05.514184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.514158    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:32:05.597721 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.597636    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\" (UniqueName: \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\") pod \"d2090987-8446-490c-abc2-16944285d75e\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") "
Oct 30 20:32:05.597868 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.597726    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\" (UniqueName: \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\") pod \"d2090987-8446-490c-abc2-16944285d75e\" (UID: \"d2090987-8446-490c-abc2-16944285d75e\") "
Oct 30 20:32:05.598148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.598112    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file" pod "d2090987-8446-490c-abc2-16944285d75e" (UID: "d2090987-8446-490c-abc2-16944285d75e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:32:05.599985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.599960    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4" pod "d2090987-8446-490c-abc2-16944285d75e" (UID: "d2090987-8446-490c-abc2-16944285d75e"). InnerVolumeSpecName "kube-api-access-7b8v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:05.699219 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.699179    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b8v4\" (UniqueName: \"kubernetes.io/projected/d2090987-8446-490c-abc2-16944285d75e-kube-api-access-7b8v4\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:05.699219 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:05.699214    5446 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2090987-8446-490c-abc2-16944285d75e-config-file\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:06.270621 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.270582    5446 generic.go:356] "Generic (PLEG): container finished" podID="d2090987-8446-490c-abc2-16944285d75e" containerID="577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7" exitCode=0
Oct 30 20:32:06.271071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.270633    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"
Oct 30 20:32:06.271071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.270663    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" event={"ID":"d2090987-8446-490c-abc2-16944285d75e","Type":"ContainerDied","Data":"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"}
Oct 30 20:32:06.271071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.270724    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-vzgbr" event={"ID":"d2090987-8446-490c-abc2-16944285d75e","Type":"ContainerDied","Data":"84ba022c269b4b47b62eac08a58f67292f63d8ace1f7ed8df5e5f0e15bf877a0"}
Oct 30 20:32:06.271071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.270747    5446 scope.go:122] "RemoveContainer" containerID="577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"
Oct 30 20:32:06.279057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.279037    5446 scope.go:122] "RemoveContainer" containerID="577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"
Oct 30 20:32:06.279385 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:32:06.279362    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7\": container with ID starting with 577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7 not found: ID does not exist" containerID="577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"
Oct 30 20:32:06.279436 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.279395    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7"} err="failed to get container status \"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7\": rpc error: code = NotFound desc = could not find container \"577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7\": container with ID starting with 577e83eaad3d484e7f94d1563f5d00344e48c36b6d0accb2cf2fb935f7b92cd7 not found: ID does not exist"
Oct 30 20:32:06.439347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.439268    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:32:06.488361 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.488330    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-vzgbr"]
Oct 30 20:32:06.983051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.983011    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"]
Oct 30 20:32:06.983363 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.983349    5446 cpu_manager.go:414] "containerMap: removing container" podUID="d2090987-8446-490c-abc2-16944285d75e" containerName="limitador"
Oct 30 20:32:06.983405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.983365    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2090987-8446-490c-abc2-16944285d75e" containerName="limitador"
Oct 30 20:32:06.983451 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.983441    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2090987-8446-490c-abc2-16944285d75e" containerName="limitador"
Oct 30 20:32:06.987598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:06.987580    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.043175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.043131    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 30 20:32:07.043568 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.043542    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"]
Oct 30 20:32:07.091698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.091666    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:32:07.091929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.091756    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 20:32:07.091929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.091801    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-mrmf5\""
Oct 30 20:32:07.091929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.091893    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 30 20:32:07.092112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.091974    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 30 20:32:07.112067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.112038    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-cert\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.112221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.112090    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqkbb\" (UniqueName: \"kubernetes.io/projected/f7f6fa90-dca7-4974-9caf-483815581b5d-kube-api-access-vqkbb\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.112221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.112168    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-metrics-certs\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.112221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.112210    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7f6fa90-dca7-4974-9caf-483815581b5d-manager-config\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.213269 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.213237    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqkbb\" (UniqueName: \"kubernetes.io/projected/f7f6fa90-dca7-4974-9caf-483815581b5d-kube-api-access-vqkbb\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.213416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.213293    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-metrics-certs\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.213416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.213351    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7f6fa90-dca7-4974-9caf-483815581b5d-manager-config\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.213416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.213388    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-cert\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.214143 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.214125    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f7f6fa90-dca7-4974-9caf-483815581b5d-manager-config\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.215866 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.215843    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-cert\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.215992 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.215905    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7f6fa90-dca7-4974-9caf-483815581b5d-metrics-certs\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.274947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.274871    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqkbb\" (UniqueName: \"kubernetes.io/projected/f7f6fa90-dca7-4974-9caf-483815581b5d-kube-api-access-vqkbb\") pod \"jobset-controller-manager-569ddf8d6f-lf226\" (UID: \"f7f6fa90-dca7-4974-9caf-483815581b5d\") " pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.299443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.299419    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:07.668856 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:07.668822    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"]
Oct 30 20:32:07.672274 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:32:07.672249    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f6fa90_dca7_4974_9caf_483815581b5d.slice/crio-96419bb1bb80240a0f38abdc759824ba9e5e5fd2ba4b1911f6fd267f96b35330 WatchSource:0}: Error finding container 96419bb1bb80240a0f38abdc759824ba9e5e5fd2ba4b1911f6fd267f96b35330: Status 404 returned error can't find the container with id 96419bb1bb80240a0f38abdc759824ba9e5e5fd2ba4b1911f6fd267f96b35330
Oct 30 20:32:08.118398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:08.118369    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2090987-8446-490c-abc2-16944285d75e" path="/var/lib/kubelet/pods/d2090987-8446-490c-abc2-16944285d75e/volumes"
Oct 30 20:32:08.279800 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:08.279769    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226" event={"ID":"f7f6fa90-dca7-4974-9caf-483815581b5d","Type":"ContainerStarted","Data":"96419bb1bb80240a0f38abdc759824ba9e5e5fd2ba4b1911f6fd267f96b35330"}
Oct 30 20:32:14.308447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:14.308413    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226" event={"ID":"f7f6fa90-dca7-4974-9caf-483815581b5d","Type":"ContainerStarted","Data":"e2508ffbcf4c288664f3a4fa0c7b0babd695684063b58e5bf455ae898a1cd88e"}
Oct 30 20:32:14.308775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:14.308626    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:14.441772 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:14.441684    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226" podStartSLOduration=2.626428093 podStartE2EDuration="8.441671001s" totalImagesPullingTime="5.815242908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:32:14.440797992 +0000 UTC m=+300.432801128" watchObservedRunningTime="2026-10-30 20:32:14.441671001 +0000 UTC m=+300.433674125"
Oct 30 20:32:19.513863 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:32:19.513824    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:32:25.318669 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:25.318637    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-569ddf8d6f-lf226"
Oct 30 20:32:49.515349 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:32:49.515312    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:32:56.285214 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.285182    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:32:56.285806 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.285396    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerName="discovery" containerID="cri-o://2b84add62178d2d96fcc0d9b9cb87f3e32451c9ea7ecf3a9fb984a9a31aab4d8" gracePeriod=30
Oct 30 20:32:56.478751 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.478720    5446 generic.go:356] "Generic (PLEG): container finished" podID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerID="2b84add62178d2d96fcc0d9b9cb87f3e32451c9ea7ecf3a9fb984a9a31aab4d8" exitCode=0
Oct 30 20:32:56.478902 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.478798    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" event={"ID":"ab260e6e-b88c-4664-97de-cdb8f827b50a","Type":"ContainerDied","Data":"2b84add62178d2d96fcc0d9b9cb87f3e32451c9ea7ecf3a9fb984a9a31aab4d8"}
Oct 30 20:32:56.528989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.528964    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:32:56.564224 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564149    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564224 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564209    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564243    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564273    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564293    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564325    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.564407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.564365    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\") pod \"ab260e6e-b88c-4664-97de-cdb8f827b50a\" (UID: \"ab260e6e-b88c-4664-97de-cdb8f827b50a\") "
Oct 30 20:32:56.565215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.565148    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:32:56.566350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.566320    5446 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-ca-configmap\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.568966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.567781    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:32:56.572499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.572380    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:32:56.572499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.572489    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "kube-api-access-wwvvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:56.572670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.572396    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:56.572670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.572526    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:32:56.572670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.572541    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig" pod "ab260e6e-b88c-4664-97de-cdb8f827b50a" (UID: "ab260e6e-b88c-4664-97de-cdb8f827b50a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:32:56.667161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667137    5446 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-csr-dns-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.667161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667162    5446 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-cacerts\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.667289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667171    5446 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab260e6e-b88c-4664-97de-cdb8f827b50a-local-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.667289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667180    5446 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-kubeconfig\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.667289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667188    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:56.667289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:56.667196    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwvvw\" (UniqueName: \"kubernetes.io/projected/ab260e6e-b88c-4664-97de-cdb8f827b50a-kube-api-access-wwvvw\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:32:57.484762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:57.484719    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf" event={"ID":"ab260e6e-b88c-4664-97de-cdb8f827b50a","Type":"ContainerDied","Data":"9284c64c48ac1a09ffaf26d1c452d9227e70c61c968bc8cc3b3a90b0632ffd13"}
Oct 30 20:32:57.484762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:57.484747    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"
Oct 30 20:32:57.485411 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:57.484803    5446 scope.go:122] "RemoveContainer" containerID="2b84add62178d2d96fcc0d9b9cb87f3e32451c9ea7ecf3a9fb984a9a31aab4d8"
Oct 30 20:32:57.699611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:57.699573    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:32:57.748892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:57.748826    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-bsrgf"]
Oct 30 20:32:58.118639 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:32:58.118608    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" path="/var/lib/kubelet/pods/ab260e6e-b88c-4664-97de-cdb8f827b50a/volumes"
Oct 30 20:33:15.033588 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.033552    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:15.033993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.033908    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerName="discovery"
Oct 30 20:33:15.033993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.033938    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerName="discovery"
Oct 30 20:33:15.034068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.034031    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab260e6e-b88c-4664-97de-cdb8f827b50a" containerName="discovery"
Oct 30 20:33:15.038331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.038314    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.090318 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.090291    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.090472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.090326    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.090472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.090378    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.090472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.090460    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptnc\" (UniqueName: \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.143472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.143442    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 20:33:15.143472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.143458    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 20:33:15.143661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.143490    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 20:33:15.143661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.143525    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rswnw\""
Oct 30 20:33:15.143661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.143587    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:33:15.144425 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.144404    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:15.191139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.191116    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.191231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.191143    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.191231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.191190    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.191313 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.191299    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptnc\" (UniqueName: \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.191745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.191730    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.193720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.193692    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.193821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.193749    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.249920 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.249894    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptnc\" (UniqueName: \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\") pod \"maas-api-6d669c7fcd-k6276\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.351676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.351619    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:15.721441 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.721415    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:15.724500 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:33:15.724472    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169db008_66ea_4cd9_afea_78553c19c5be.slice/crio-6eebff6dddc85424d344e9de1c4f668c9988badb33591c75c6cdfcc0935695d6 WatchSource:0}: Error finding container 6eebff6dddc85424d344e9de1c4f668c9988badb33591c75c6cdfcc0935695d6: Status 404 returned error can't find the container with id 6eebff6dddc85424d344e9de1c4f668c9988badb33591c75c6cdfcc0935695d6
Oct 30 20:33:15.725711 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:15.725691    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:33:16.559069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:16.559030    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" event={"ID":"169db008-66ea-4cd9-afea-78553c19c5be","Type":"ContainerStarted","Data":"6eebff6dddc85424d344e9de1c4f668c9988badb33591c75c6cdfcc0935695d6"}
Oct 30 20:33:19.515958 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:19.515878    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:33:19.574287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:19.574258    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" event={"ID":"169db008-66ea-4cd9-afea-78553c19c5be","Type":"ContainerStarted","Data":"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"}
Oct 30 20:33:19.574455 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:19.574336    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:19.690681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:19.690629    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" podStartSLOduration=2.74590995 podStartE2EDuration="5.690615401s" totalImagesPullingTime="2.944705451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:19.68925831 +0000 UTC m=+365.681261440" watchObservedRunningTime="2026-10-30 20:33:19.690615401 +0000 UTC m=+365.682618527"
Oct 30 20:33:25.583730 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:25.583656    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:26.425477 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.425443    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:26.428541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.428520    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:26.484889 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.484862    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:26.487033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.487008    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnsf8\" (UniqueName: \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\") pod \"authorino-6f6944bcdd-xbs6g\" (UID: \"d35d2b84-9f9c-4bfa-a038-4ef012fe424d\") " pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:26.588434 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.588408    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnsf8\" (UniqueName: \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\") pod \"authorino-6f6944bcdd-xbs6g\" (UID: \"d35d2b84-9f9c-4bfa-a038-4ef012fe424d\") " pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:26.615343 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.615320    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 20:33:26.618456 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.618442    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.646192 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.646172    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnsf8\" (UniqueName: \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\") pod \"authorino-6f6944bcdd-xbs6g\" (UID: \"d35d2b84-9f9c-4bfa-a038-4ef012fe424d\") " pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:26.677807 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.677725    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 20:33:26.689681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.689663    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.689790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.689695    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd28c\" (UniqueName: \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.689790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.689728    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.689790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.689742    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.738798 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.738776    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:26.790565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.790536    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.790665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.790581    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.790732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.790672    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.790732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.790716    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd28c\" (UniqueName: \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.791310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.791287    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.793445 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.793395    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.794589 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.794558    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.801084 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.801059    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:26.827415 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.827394    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:26.831645 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.831631    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:26.849953 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.849906    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd28c\" (UniqueName: \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\") pod \"maas-api-84b5f84777-r2nm8\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") " pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.886938 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.886893    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:26.892235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.892209    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpq6l\" (UniqueName: \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\") pod \"authorino-867c586799-wzdjg\" (UID: \"a7f2b5ab-04cf-4d94-9413-0c187a92089c\") " pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:26.930743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.930699    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:26.993540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:26.993516    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpq6l\" (UniqueName: \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\") pod \"authorino-867c586799-wzdjg\" (UID: \"a7f2b5ab-04cf-4d94-9413-0c187a92089c\") " pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:27.051131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.051106    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpq6l\" (UniqueName: \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\") pod \"authorino-867c586799-wzdjg\" (UID: \"a7f2b5ab-04cf-4d94-9413-0c187a92089c\") " pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:27.104645 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.104613    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:27.108039 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:33:27.108015    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd35d2b84_9f9c_4bfa_a038_4ef012fe424d.slice/crio-7ab4201827f57e05ba2bf51205d14b57dd89986d6977d35e327a32fe3eddbbbe WatchSource:0}: Error finding container 7ab4201827f57e05ba2bf51205d14b57dd89986d6977d35e327a32fe3eddbbbe: Status 404 returned error can't find the container with id 7ab4201827f57e05ba2bf51205d14b57dd89986d6977d35e327a32fe3eddbbbe
Oct 30 20:33:27.142366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.142344    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:27.265398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.265374    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:27.290854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.290828    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:33:27.295049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.295033    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.302110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.302087    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 20:33:27.304765 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:33:27.304743    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5d43da_4997_4577_b30a_bc024bb908f3.slice/crio-1e39040913d9d345ed5a021e7ad77d38d4805ac9b905f001444bb83cf90254e5 WatchSource:0}: Error finding container 1e39040913d9d345ed5a021e7ad77d38d4805ac9b905f001444bb83cf90254e5: Status 404 returned error can't find the container with id 1e39040913d9d345ed5a021e7ad77d38d4805ac9b905f001444bb83cf90254e5
Oct 30 20:33:27.349627 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.349607    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 20:33:27.350561 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.350531    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:33:27.397435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.397415    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.397543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.397479    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ldp\" (UniqueName: \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.498579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.498520    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ldp\" (UniqueName: \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.498771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.498573    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.501059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.501040    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.507757 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.507738    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:27.511368 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:33:27.511342    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7f2b5ab_04cf_4d94_9413_0c187a92089c.slice/crio-4d4d522180cab9d0ac9b79b2cf991fc2eca520cfd30b61e461d87812eaadaff5 WatchSource:0}: Error finding container 4d4d522180cab9d0ac9b79b2cf991fc2eca520cfd30b61e461d87812eaadaff5: Status 404 returned error can't find the container with id 4d4d522180cab9d0ac9b79b2cf991fc2eca520cfd30b61e461d87812eaadaff5
Oct 30 20:33:27.556443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.556424    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ldp\" (UniqueName: \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\") pod \"authorino-7c6b9464b5-pk6vd\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") " pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.606257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.606230    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:33:27.610000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.609974    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" event={"ID":"d35d2b84-9f9c-4bfa-a038-4ef012fe424d","Type":"ContainerStarted","Data":"7ab4201827f57e05ba2bf51205d14b57dd89986d6977d35e327a32fe3eddbbbe"}
Oct 30 20:33:27.611684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.611665    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c586799-wzdjg" event={"ID":"a7f2b5ab-04cf-4d94-9413-0c187a92089c","Type":"ContainerStarted","Data":"4d4d522180cab9d0ac9b79b2cf991fc2eca520cfd30b61e461d87812eaadaff5"}
Oct 30 20:33:27.612984 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.612958    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" event={"ID":"ce5d43da-4997-4577-b30a-bc024bb908f3","Type":"ContainerStarted","Data":"1e39040913d9d345ed5a021e7ad77d38d4805ac9b905f001444bb83cf90254e5"}
Oct 30 20:33:27.977933 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:27.977878    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:33:27.981411 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:33:27.981369    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2278894d_2743_4086_be12_93936cc8887b.slice/crio-6cbd61c183e2e0cf482d4d994590dfe422ceccd15d3b95d149c20602af1a3181 WatchSource:0}: Error finding container 6cbd61c183e2e0cf482d4d994590dfe422ceccd15d3b95d149c20602af1a3181: Status 404 returned error can't find the container with id 6cbd61c183e2e0cf482d4d994590dfe422ceccd15d3b95d149c20602af1a3181
Oct 30 20:33:28.618528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:28.618493    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" event={"ID":"2278894d-2743-4086-be12-93936cc8887b","Type":"ContainerStarted","Data":"6cbd61c183e2e0cf482d4d994590dfe422ceccd15d3b95d149c20602af1a3181"}
Oct 30 20:33:28.620110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:28.620080    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" event={"ID":"ce5d43da-4997-4577-b30a-bc024bb908f3","Type":"ContainerStarted","Data":"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"}
Oct 30 20:33:28.620264 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:28.620205    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:28.737007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:28.736967    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" podStartSLOduration=1.945926798 podStartE2EDuration="2.736953949s" totalImagesPullingTime="791.027151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:28.735262785 +0000 UTC m=+374.727265911" watchObservedRunningTime="2026-10-30 20:33:28.736953949 +0000 UTC m=+374.728957073"
Oct 30 20:33:29.627146 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.627045    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" event={"ID":"d35d2b84-9f9c-4bfa-a038-4ef012fe424d","Type":"ContainerStarted","Data":"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"}
Oct 30 20:33:29.627146 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.627128    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" podUID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" containerName="authorino" containerID="cri-o://a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a" gracePeriod=30
Oct 30 20:33:29.629073 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.629042    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" event={"ID":"2278894d-2743-4086-be12-93936cc8887b","Type":"ContainerStarted","Data":"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"}
Oct 30 20:33:29.742542 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.742489    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" podStartSLOduration=1.9696901530000002 podStartE2EDuration="3.742474195s" totalImagesPullingTime="1.772784042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:29.741831016 +0000 UTC m=+375.733834164" watchObservedRunningTime="2026-10-30 20:33:29.742474195 +0000 UTC m=+375.734477323"
Oct 30 20:33:29.855834 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.855787    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" podStartSLOduration=1.462711971 podStartE2EDuration="2.855772689s" totalImagesPullingTime="1.393060718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:29.855735745 +0000 UTC m=+375.847738872" watchObservedRunningTime="2026-10-30 20:33:29.855772689 +0000 UTC m=+375.847775815"
Oct 30 20:33:29.860754 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.860735    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:29.886350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.886286    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:33:29.886512 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:29.886481    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" podUID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" containerName="authorino" containerID="cri-o://cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e" gracePeriod=30
Oct 30 20:33:30.021321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.021289    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\" (UniqueName: \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\") pod \"d35d2b84-9f9c-4bfa-a038-4ef012fe424d\" (UID: \"d35d2b84-9f9c-4bfa-a038-4ef012fe424d\") "
Oct 30 20:33:30.023344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.023320    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8" pod "d35d2b84-9f9c-4bfa-a038-4ef012fe424d" (UID: "d35d2b84-9f9c-4bfa-a038-4ef012fe424d"). InnerVolumeSpecName "kube-api-access-xnsf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:30.122113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.122078    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnsf8\" (UniqueName: \"kubernetes.io/projected/d35d2b84-9f9c-4bfa-a038-4ef012fe424d-kube-api-access-xnsf8\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:30.138107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.138055    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:33:30.223148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.223111    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\" (UniqueName: \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\") pod \"4e150c6b-39ae-47e5-afd2-205d54bc8c63\" (UID: \"4e150c6b-39ae-47e5-afd2-205d54bc8c63\") "
Oct 30 20:33:30.225358 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.225331    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd" pod "4e150c6b-39ae-47e5-afd2-205d54bc8c63" (UID: "4e150c6b-39ae-47e5-afd2-205d54bc8c63"). InnerVolumeSpecName "kube-api-access-7v9nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:30.324027 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.323996    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v9nd\" (UniqueName: \"kubernetes.io/projected/4e150c6b-39ae-47e5-afd2-205d54bc8c63-kube-api-access-7v9nd\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:30.634008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.633970    5446 generic.go:356] "Generic (PLEG): container finished" podID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" containerID="cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e" exitCode=0
Oct 30 20:33:30.634470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.634011    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6"
Oct 30 20:33:30.634470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.634058    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" event={"ID":"4e150c6b-39ae-47e5-afd2-205d54bc8c63","Type":"ContainerDied","Data":"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"}
Oct 30 20:33:30.634470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.634102    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-zlxs6" event={"ID":"4e150c6b-39ae-47e5-afd2-205d54bc8c63","Type":"ContainerDied","Data":"9e830fc4881347bdc0cba75756f24dfd33b8c4308d72701b068c050c6d2de884"}
Oct 30 20:33:30.634470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.634124    5446 scope.go:122] "RemoveContainer" containerID="cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"
Oct 30 20:33:30.635572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.635482    5446 generic.go:356] "Generic (PLEG): container finished" podID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" containerID="a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a" exitCode=0
Oct 30 20:33:30.635572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.635566    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g"
Oct 30 20:33:30.635693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.635603    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" event={"ID":"d35d2b84-9f9c-4bfa-a038-4ef012fe424d","Type":"ContainerDied","Data":"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"}
Oct 30 20:33:30.635693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.635634    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-xbs6g" event={"ID":"d35d2b84-9f9c-4bfa-a038-4ef012fe424d","Type":"ContainerDied","Data":"7ab4201827f57e05ba2bf51205d14b57dd89986d6977d35e327a32fe3eddbbbe"}
Oct 30 20:33:30.646069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.644501    5446 scope.go:122] "RemoveContainer" containerID="cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"
Oct 30 20:33:30.646069 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:30.644865    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e\": container with ID starting with cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e not found: ID does not exist" containerID="cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"
Oct 30 20:33:30.646069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.644896    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e"} err="failed to get container status \"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e\": rpc error: code = NotFound desc = could not find container \"cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e\": container with ID starting with cc41cfe2bf56ae735989fd18d088db3a945cea9f64feae60741ed0c7aca57e5e not found: ID does not exist"
Oct 30 20:33:30.646069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.644963    5446 scope.go:122] "RemoveContainer" containerID="a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"
Oct 30 20:33:30.657139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.657121    5446 scope.go:122] "RemoveContainer" containerID="a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"
Oct 30 20:33:30.657489 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:30.657461    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a\": container with ID starting with a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a not found: ID does not exist" containerID="a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"
Oct 30 20:33:30.657567 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.657500    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a"} err="failed to get container status \"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a\": rpc error: code = NotFound desc = could not find container \"a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a\": container with ID starting with a8b06f2af79f58c3c7f8852f54dddcf4ce8fc4eb90f790d84108d0d80635893a not found: ID does not exist"
Oct 30 20:33:30.801090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.801057    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:33:30.807197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.807172    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-zlxs6"]
Oct 30 20:33:30.920400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.920374    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:30.925740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:30.925721    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-xbs6g"]
Oct 30 20:33:32.117701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:32.117663    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" path="/var/lib/kubelet/pods/4e150c6b-39ae-47e5-afd2-205d54bc8c63/volumes"
Oct 30 20:33:32.118117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:32.118017    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" path="/var/lib/kubelet/pods/d35d2b84-9f9c-4bfa-a038-4ef012fe424d/volumes"
Oct 30 20:33:33.651487 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:33.651454    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c586799-wzdjg" event={"ID":"a7f2b5ab-04cf-4d94-9413-0c187a92089c","Type":"ContainerStarted","Data":"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"}
Oct 30 20:33:33.651873 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:33.651527    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-867c586799-wzdjg" podUID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" containerName="authorino" containerID="cri-o://80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86" gracePeriod=30
Oct 30 20:33:33.765175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:33.765134    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-867c586799-wzdjg" podStartSLOduration=1.825847699 podStartE2EDuration="7.765117931s" totalImagesPullingTime="5.939270232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:33.763661978 +0000 UTC m=+379.755665099" watchObservedRunningTime="2026-10-30 20:33:33.765117931 +0000 UTC m=+379.757121052"
Oct 30 20:33:33.892018 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:33.891992    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:34.051352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.051279    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\" (UniqueName: \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\") pod \"a7f2b5ab-04cf-4d94-9413-0c187a92089c\" (UID: \"a7f2b5ab-04cf-4d94-9413-0c187a92089c\") "
Oct 30 20:33:34.053394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.053369    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l" pod "a7f2b5ab-04cf-4d94-9413-0c187a92089c" (UID: "a7f2b5ab-04cf-4d94-9413-0c187a92089c"). InnerVolumeSpecName "kube-api-access-xpq6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:34.152813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.152786    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpq6l\" (UniqueName: \"kubernetes.io/projected/a7f2b5ab-04cf-4d94-9413-0c187a92089c-kube-api-access-xpq6l\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:34.634342 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.634314    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 20:33:34.656603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.656569    5446 generic.go:356] "Generic (PLEG): container finished" podID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" containerID="80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86" exitCode=0
Oct 30 20:33:34.656965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.656607    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c586799-wzdjg"
Oct 30 20:33:34.656965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.656633    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c586799-wzdjg" event={"ID":"a7f2b5ab-04cf-4d94-9413-0c187a92089c","Type":"ContainerDied","Data":"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"}
Oct 30 20:33:34.656965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.656668    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c586799-wzdjg" event={"ID":"a7f2b5ab-04cf-4d94-9413-0c187a92089c","Type":"ContainerDied","Data":"4d4d522180cab9d0ac9b79b2cf991fc2eca520cfd30b61e461d87812eaadaff5"}
Oct 30 20:33:34.656965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.656686    5446 scope.go:122] "RemoveContainer" containerID="80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"
Oct 30 20:33:34.664868 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.664852    5446 scope.go:122] "RemoveContainer" containerID="80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"
Oct 30 20:33:34.665154 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:34.665134    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86\": container with ID starting with 80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86 not found: ID does not exist" containerID="80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"
Oct 30 20:33:34.665244 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.665160    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86"} err="failed to get container status \"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86\": rpc error: code = NotFound desc = could not find container \"80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86\": container with ID starting with 80db259321fae986ee5b1f01a0331491d9aba1a87edcd3894779adbb08689a86 not found: ID does not exist"
Oct 30 20:33:34.800658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.800632    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:34.800867 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.800839    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" podUID="169db008-66ea-4cd9-afea-78553c19c5be" containerName="maas-api" containerID="cri-o://a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6" gracePeriod=30
Oct 30 20:33:34.861681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.861659    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:34.866909 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:34.866888    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-867c586799-wzdjg"]
Oct 30 20:33:35.034134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.034110    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:35.160253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.160229    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\" (UniqueName: \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\") pod \"169db008-66ea-4cd9-afea-78553c19c5be\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") "
Oct 30 20:33:35.160386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.160274    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\") pod \"169db008-66ea-4cd9-afea-78553c19c5be\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") "
Oct 30 20:33:35.160386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.160298    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\") pod \"169db008-66ea-4cd9-afea-78553c19c5be\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") "
Oct 30 20:33:35.160386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.160323    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\") pod \"169db008-66ea-4cd9-afea-78553c19c5be\" (UID: \"169db008-66ea-4cd9-afea-78553c19c5be\") "
Oct 30 20:33:35.160706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.160683    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca" pod "169db008-66ea-4cd9-afea-78553c19c5be" (UID: "169db008-66ea-4cd9-afea-78553c19c5be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:35.162591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.162562    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs" pod "169db008-66ea-4cd9-afea-78553c19c5be" (UID: "169db008-66ea-4cd9-afea-78553c19c5be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:33:35.162688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.162647    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls" pod "169db008-66ea-4cd9-afea-78553c19c5be" (UID: "169db008-66ea-4cd9-afea-78553c19c5be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:33:35.162758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.162711    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc" pod "169db008-66ea-4cd9-afea-78553c19c5be" (UID: "169db008-66ea-4cd9-afea-78553c19c5be"). InnerVolumeSpecName "kube-api-access-9ptnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:35.261633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.261587    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ptnc\" (UniqueName: \"kubernetes.io/projected/169db008-66ea-4cd9-afea-78553c19c5be-kube-api-access-9ptnc\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:35.261633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.261606    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:35.261633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.261616    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/169db008-66ea-4cd9-afea-78553c19c5be-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:35.261633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.261624    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/169db008-66ea-4cd9-afea-78553c19c5be-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:33:35.662787 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.662754    5446 generic.go:356] "Generic (PLEG): container finished" podID="169db008-66ea-4cd9-afea-78553c19c5be" containerID="a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6" exitCode=0
Oct 30 20:33:35.663183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.662801    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"
Oct 30 20:33:35.663183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.662843    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" event={"ID":"169db008-66ea-4cd9-afea-78553c19c5be","Type":"ContainerDied","Data":"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"}
Oct 30 20:33:35.663183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.662891    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276" event={"ID":"169db008-66ea-4cd9-afea-78553c19c5be","Type":"ContainerDied","Data":"6eebff6dddc85424d344e9de1c4f668c9988badb33591c75c6cdfcc0935695d6"}
Oct 30 20:33:35.663183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.662928    5446 scope.go:122] "RemoveContainer" containerID="a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"
Oct 30 20:33:35.671663 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.671646    5446 scope.go:122] "RemoveContainer" containerID="a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"
Oct 30 20:33:35.671969 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:35.671950    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6\": container with ID starting with a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6 not found: ID does not exist" containerID="a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"
Oct 30 20:33:35.672031 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.671980    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6"} err="failed to get container status \"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6\": rpc error: code = NotFound desc = could not find container \"a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6\": container with ID starting with a60d51c53d8c8bdd04ddb50b67aef748d25e3f9fab1db62781178384cd7aa9b6 not found: ID does not exist"
Oct 30 20:33:35.829154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.829129    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:35.878231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:35.878203    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-k6276"]
Oct 30 20:33:36.118350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:36.118320    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="169db008-66ea-4cd9-afea-78553c19c5be" path="/var/lib/kubelet/pods/169db008-66ea-4cd9-afea-78553c19c5be/volumes"
Oct 30 20:33:36.118662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:33:36.118646    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" path="/var/lib/kubelet/pods/a7f2b5ab-04cf-4d94-9413-0c187a92089c/volumes"
Oct 30 20:33:49.514409 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:33:49.514370    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:34:19.514759 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:34:19.514723    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:34:49.515313 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:34:49.515272    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:35:06.778273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778240    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"]
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778559    5446 cpu_manager.go:414] "containerMap: removing container" podUID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778571    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778583    5446 cpu_manager.go:414] "containerMap: removing container" podUID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778588    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778600    5446 cpu_manager.go:414] "containerMap: removing container" podUID="169db008-66ea-4cd9-afea-78553c19c5be" containerName="maas-api"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778605    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="169db008-66ea-4cd9-afea-78553c19c5be" containerName="maas-api"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778621    5446 cpu_manager.go:414] "containerMap: removing container" podUID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778626    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778669    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="d35d2b84-9f9c-4bfa-a038-4ef012fe424d" containerName="authorino"
Oct 30 20:35:06.778674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778679    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e150c6b-39ae-47e5-afd2-205d54bc8c63" containerName="authorino"
Oct 30 20:35:06.779057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778687    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7f2b5ab-04cf-4d94-9413-0c187a92089c" containerName="authorino"
Oct 30 20:35:06.779057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.778693    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="169db008-66ea-4cd9-afea-78553c19c5be" containerName="maas-api"
Oct 30 20:35:06.783951 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.782675    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.888259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.888224    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 20:35:06.888448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.888283    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 20:35:06.888448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.888321    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 30 20:35:06.888448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.888356    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zzf7l\""
Oct 30 20:35:06.889227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.889210    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"]
Oct 30 20:35:06.930758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.930728    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0868fc8e-eb11-4328-b235-6f76f8a82460-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.930884 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.930768    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.930884 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.930786    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq2tt\" (UniqueName: \"kubernetes.io/projected/0868fc8e-eb11-4328-b235-6f76f8a82460-kube-api-access-qq2tt\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.931019 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.930936    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.931077 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.931029    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:06.931130 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:06.931076    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.031908 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.031852    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0868fc8e-eb11-4328-b235-6f76f8a82460-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.031908 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.031882    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.031908 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.031900    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq2tt\" (UniqueName: \"kubernetes.io/projected/0868fc8e-eb11-4328-b235-6f76f8a82460-kube-api-access-qq2tt\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.031940    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.031971    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.032007    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032337 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.032316    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.032346    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.032472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.032450    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.034354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.034338    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0868fc8e-eb11-4328-b235-6f76f8a82460-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.034466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.034444    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0868fc8e-eb11-4328-b235-6f76f8a82460-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.089668 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.089644    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq2tt\" (UniqueName: \"kubernetes.io/projected/0868fc8e-eb11-4328-b235-6f76f8a82460-kube-api-access-qq2tt\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn\" (UID: \"0868fc8e-eb11-4328-b235-6f76f8a82460\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.095537 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.095520    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:07.464078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:07.464046    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"]
Oct 30 20:35:07.467026 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:07.466999    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0868fc8e_eb11_4328_b235_6f76f8a82460.slice/crio-044c3e914978661212fa1aed857f25b7a5a4fd5fd531af24e7caed3ef717b827 WatchSource:0}: Error finding container 044c3e914978661212fa1aed857f25b7a5a4fd5fd531af24e7caed3ef717b827: Status 404 returned error can't find the container with id 044c3e914978661212fa1aed857f25b7a5a4fd5fd531af24e7caed3ef717b827
Oct 30 20:35:08.029195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:08.029162    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn" event={"ID":"0868fc8e-eb11-4328-b235-6f76f8a82460","Type":"ContainerStarted","Data":"044c3e914978661212fa1aed857f25b7a5a4fd5fd531af24e7caed3ef717b827"}
Oct 30 20:35:10.039347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:10.039312    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn" event={"ID":"0868fc8e-eb11-4328-b235-6f76f8a82460","Type":"ContainerStarted","Data":"3f18f8db79b2943d368c42bc3aa0e30afa0f42b26784660da11c0275fff53bed"}
Oct 30 20:35:10.095947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:10.095896    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:10.157556 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:10.157508    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn" podStartSLOduration=2.105825616 podStartE2EDuration="4.157492957s" totalImagesPullingTime="2.051667341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:10.155719663 +0000 UTC m=+476.147722790" watchObservedRunningTime="2026-10-30 20:35:10.157492957 +0000 UTC m=+476.149496084"
Oct 30 20:35:13.039193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.039162    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"]
Oct 30 20:35:13.042544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.042525    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.145076 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.145049    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 30 20:35:13.146138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.146117    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"]
Oct 30 20:35:13.183553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183523    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.183666 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183565    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47fb9715-f515-4d27-9657-00908b6e3de3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.183708 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183683    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.183742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183713    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.183825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183807    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5szk\" (UniqueName: \"kubernetes.io/projected/47fb9715-f515-4d27-9657-00908b6e3de3-kube-api-access-f5szk\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.183869 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.183854    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284518    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284557    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284728 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284675    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47fb9715-f515-4d27-9657-00908b6e3de3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284728 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284718    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284860 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284834    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284865    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.284944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.284909    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5szk\" (UniqueName: \"kubernetes.io/projected/47fb9715-f515-4d27-9657-00908b6e3de3-kube-api-access-f5szk\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.285036 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.285008    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.285196 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.285171    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.286943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.286907    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47fb9715-f515-4d27-9657-00908b6e3de3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.287324 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.287303    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47fb9715-f515-4d27-9657-00908b6e3de3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.345140 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.345088    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5szk\" (UniqueName: \"kubernetes.io/projected/47fb9715-f515-4d27-9657-00908b6e3de3-kube-api-access-f5szk\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5\" (UID: \"47fb9715-f515-4d27-9657-00908b6e3de3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.354067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.354046    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:13.723716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:13.723689    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"]
Oct 30 20:35:13.726600 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:13.726575    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47fb9715_f515_4d27_9657_00908b6e3de3.slice/crio-fd81030bf5630dc5a81cce724d0c50fcc84119964483b18c561e04678ade49d8 WatchSource:0}: Error finding container fd81030bf5630dc5a81cce724d0c50fcc84119964483b18c561e04678ade49d8: Status 404 returned error can't find the container with id fd81030bf5630dc5a81cce724d0c50fcc84119964483b18c561e04678ade49d8
Oct 30 20:35:14.057254 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:14.057178    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" event={"ID":"47fb9715-f515-4d27-9657-00908b6e3de3","Type":"ContainerStarted","Data":"fd81030bf5630dc5a81cce724d0c50fcc84119964483b18c561e04678ade49d8"}
Oct 30 20:35:15.062162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:15.062132    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" event={"ID":"47fb9715-f515-4d27-9657-00908b6e3de3","Type":"ContainerStarted","Data":"db96cc5ff682ccbbb8d79e42726a0cffc018033d37c4231a5605a60e7f2dd2c7"}
Oct 30 20:35:15.197337 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:15.197295    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podStartSLOduration=2.610359507 podStartE2EDuration="3.197280555s" totalImagesPullingTime="586.921048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:15.196940852 +0000 UTC m=+481.188943981" watchObservedRunningTime="2026-10-30 20:35:15.197280555 +0000 UTC m=+481.189283682"
Oct 30 20:35:15.354606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:15.354541    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:17.096565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.096526    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:17.108806 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.108779    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:17.477928 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.477896    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"]
Oct 30 20:35:17.481310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.481295    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.534838 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.534816    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 20:35:17.540283 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.540261    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"]
Oct 30 20:35:17.621322 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621297    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.621484 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621335    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.621484 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621353    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.621571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621504    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.621571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621540    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmn9w\" (UniqueName: \"kubernetes.io/projected/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-kube-api-access-fmn9w\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.621571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.621561    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722162    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmn9w\" (UniqueName: \"kubernetes.io/projected/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-kube-api-access-fmn9w\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722325 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722193    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722325 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722221    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722334    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722365    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722414    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722594    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722852 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722825    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.722979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.722836    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.724657 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.724629    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.724885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.724867    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.781080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.781025    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmn9w\" (UniqueName: \"kubernetes.io/projected/9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa-kube-api-access-fmn9w\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p\" (UID: \"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:17.792854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:17.792834    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:18.086068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:18.085996    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn"
Oct 30 20:35:18.161803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:18.161721    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"]
Oct 30 20:35:18.164280 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:18.164249    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2ab5d7_d4cd_41f3_a1e3_9b68bb207dfa.slice/crio-06febbad3a1c8c0a4d0a1737da3adbb650328b3970344fc20fcdaa494ac59f88 WatchSource:0}: Error finding container 06febbad3a1c8c0a4d0a1737da3adbb650328b3970344fc20fcdaa494ac59f88: Status 404 returned error can't find the container with id 06febbad3a1c8c0a4d0a1737da3adbb650328b3970344fc20fcdaa494ac59f88
Oct 30 20:35:19.084396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:19.084307    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p" event={"ID":"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa","Type":"ContainerStarted","Data":"38d005f37a05dd76e4c8c38a224089ffbb15e9fdd0d1c0179f26a66ab6d396f2"}
Oct 30 20:35:19.084396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:19.084371    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p" event={"ID":"9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa","Type":"ContainerStarted","Data":"06febbad3a1c8c0a4d0a1737da3adbb650328b3970344fc20fcdaa494ac59f88"}
Oct 30 20:35:19.200799 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:19.200754    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p" podStartSLOduration=1.595007174 podStartE2EDuration="2.200740863s" totalImagesPullingTime="605.733689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:19.199936139 +0000 UTC m=+485.191939263" watchObservedRunningTime="2026-10-30 20:35:19.200740863 +0000 UTC m=+485.192743990"
Oct 30 20:35:19.514560 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:35:19.514527    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:35:19.793969 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:19.793896    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:22.336014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.335979    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"]
Oct 30 20:35:22.339354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.339338    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.354842 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.354815    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.354985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.354849    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.354985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.354880    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.354985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.354963    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.355118 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.355066    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f58c83-143c-409c-acda-d1355f4d6f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.355118 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.355088    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfm7\" (UniqueName: \"kubernetes.io/projected/11f58c83-143c-409c-acda-d1355f4d6f1e-kube-api-access-hkfm7\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.414959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.414936    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 20:35:22.442672 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.442650    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"]
Oct 30 20:35:22.455460 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455436    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f58c83-143c-409c-acda-d1355f4d6f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455460 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455461    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfm7\" (UniqueName: \"kubernetes.io/projected/11f58c83-143c-409c-acda-d1355f4d6f1e-kube-api-access-hkfm7\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455490    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455516    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455558    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455579    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.455989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.455967    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.456063 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.456000    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.456063 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.456040    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.457851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.457829    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f58c83-143c-409c-acda-d1355f4d6f1e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.458051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.458032    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f58c83-143c-409c-acda-d1355f4d6f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.513745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.513715    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfm7\" (UniqueName: \"kubernetes.io/projected/11f58c83-143c-409c-acda-d1355f4d6f1e-kube-api-access-hkfm7\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vpvxp\" (UID: \"11f58c83-143c-409c-acda-d1355f4d6f1e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:22.651828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:22.651806    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:23.028413 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:23.024750    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"]
Oct 30 20:35:23.031814 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:23.031787    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f58c83_143c_409c_acda_d1355f4d6f1e.slice/crio-b0c816394427d0762e9f70c4772701a697cccc81e9a74a2b7bfdaedd9cb173bf WatchSource:0}: Error finding container b0c816394427d0762e9f70c4772701a697cccc81e9a74a2b7bfdaedd9cb173bf: Status 404 returned error can't find the container with id b0c816394427d0762e9f70c4772701a697cccc81e9a74a2b7bfdaedd9cb173bf
Oct 30 20:35:23.101689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:23.101664    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp" event={"ID":"11f58c83-143c-409c-acda-d1355f4d6f1e","Type":"ContainerStarted","Data":"b0c816394427d0762e9f70c4772701a697cccc81e9a74a2b7bfdaedd9cb173bf"}
Oct 30 20:35:23.354366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:23.354287    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:23.367087 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:23.367066    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:24.106878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:24.106797    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp" event={"ID":"11f58c83-143c-409c-acda-d1355f4d6f1e","Type":"ContainerStarted","Data":"b2424f3e1c8408d63c4ee712dc2c6aecb1ac608338f6810983b4ca760ad14a75"}
Oct 30 20:35:24.118502 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:24.118478    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:35:24.225020 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:24.224974    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp" podStartSLOduration=1.6243759450000002 podStartE2EDuration="2.224959241s" totalImagesPullingTime="600.583296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:24.223726237 +0000 UTC m=+490.215729365" watchObservedRunningTime="2026-10-30 20:35:24.224959241 +0000 UTC m=+490.216962398"
Oct 30 20:35:24.652197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:24.652167    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:26.256052 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.256019    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"]
Oct 30 20:35:26.259571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.259548    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282256    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86511d0a-2335-49fa-875f-3c2e88d49bc7-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282423 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282328    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282423 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282354    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282423 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282402    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkcv\" (UniqueName: \"kubernetes.io/projected/86511d0a-2335-49fa-875f-3c2e88d49bc7-kube-api-access-6bkcv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282520    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.282604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.282558    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.332352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.332315    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 20:35:26.362624 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.362587    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"]
Oct 30 20:35:26.383302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383274    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86511d0a-2335-49fa-875f-3c2e88d49bc7-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383327    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383346    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383381    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkcv\" (UniqueName: \"kubernetes.io/projected/86511d0a-2335-49fa-875f-3c2e88d49bc7-kube-api-access-6bkcv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383401    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383416    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383786    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383825    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.383887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.383848    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.385744 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.385722    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86511d0a-2335-49fa-875f-3c2e88d49bc7-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.385846 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.385834    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86511d0a-2335-49fa-875f-3c2e88d49bc7-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.443713 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.443677    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkcv\" (UniqueName: \"kubernetes.io/projected/86511d0a-2335-49fa-875f-3c2e88d49bc7-kube-api-access-6bkcv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-s2fhj\" (UID: \"86511d0a-2335-49fa-875f-3c2e88d49bc7\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.574552 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.574467    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:26.949515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:26.949482    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"]
Oct 30 20:35:26.952465 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:26.952433    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86511d0a_2335_49fa_875f_3c2e88d49bc7.slice/crio-3329c34aae4983f3a66ef538266f5463474ef7b9de871a77b8d1b26b9ee1e29f WatchSource:0}: Error finding container 3329c34aae4983f3a66ef538266f5463474ef7b9de871a77b8d1b26b9ee1e29f: Status 404 returned error can't find the container with id 3329c34aae4983f3a66ef538266f5463474ef7b9de871a77b8d1b26b9ee1e29f
Oct 30 20:35:27.124394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:27.124365    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj" event={"ID":"86511d0a-2335-49fa-875f-3c2e88d49bc7","Type":"ContainerStarted","Data":"3329c34aae4983f3a66ef538266f5463474ef7b9de871a77b8d1b26b9ee1e29f"}
Oct 30 20:35:27.793198 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:27.793163    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:27.805405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:27.805348    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:28.129757 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:28.129723    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj" event={"ID":"86511d0a-2335-49fa-875f-3c2e88d49bc7","Type":"ContainerStarted","Data":"78f45f29c2917b0f098eb47e242464474bdb3185effb939d230326b9154c1bb4"}
Oct 30 20:35:28.141080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:28.141060    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p"
Oct 30 20:35:28.249469 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:28.249415    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj" podStartSLOduration=1.6571870579999999 podStartE2EDuration="2.249397053s" totalImagesPullingTime="592.209995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:28.248155491 +0000 UTC m=+494.240158617" watchObservedRunningTime="2026-10-30 20:35:28.249397053 +0000 UTC m=+494.241400212"
Oct 30 20:35:28.575203 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:28.575122    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:29.414905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.414874    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"]
Oct 30 20:35:29.418227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.418212    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511407    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511578 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511473    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511578 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511537    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a64b45d-291b-448f-a9e6-4d502a67b547-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511592    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5rdl\" (UniqueName: \"kubernetes.io/projected/6a64b45d-291b-448f-a9e6-4d502a67b547-kube-api-access-x5rdl\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511624    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.511719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.511653    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.520315 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.520299    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 20:35:29.521531 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.521514    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"]
Oct 30 20:35:29.612635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612609    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.612742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612640    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.612742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612668    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.612742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612711    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.612742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612730    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a64b45d-291b-448f-a9e6-4d502a67b547-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.613274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.612750    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5rdl\" (UniqueName: \"kubernetes.io/projected/6a64b45d-291b-448f-a9e6-4d502a67b547-kube-api-access-x5rdl\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.613274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.613087    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.613274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.613110    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.613274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.613225    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.615039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.615021    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a64b45d-291b-448f-a9e6-4d502a67b547-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.615297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.615276    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a64b45d-291b-448f-a9e6-4d502a67b547-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.673890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.673822    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5rdl\" (UniqueName: \"kubernetes.io/projected/6a64b45d-291b-448f-a9e6-4d502a67b547-kube-api-access-x5rdl\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-gz8hl\" (UID: \"6a64b45d-291b-448f-a9e6-4d502a67b547\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:29.730411 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:29.730382    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:30.102609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.102540    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"]
Oct 30 20:35:30.105553 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:30.105527    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a64b45d_291b_448f_a9e6_4d502a67b547.slice/crio-f170619d23124b0ab02713ce5d40120989eacc4d1006e6a047904f1c73c8abe7 WatchSource:0}: Error finding container f170619d23124b0ab02713ce5d40120989eacc4d1006e6a047904f1c73c8abe7: Status 404 returned error can't find the container with id f170619d23124b0ab02713ce5d40120989eacc4d1006e6a047904f1c73c8abe7
Oct 30 20:35:30.139882 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.139854    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl" event={"ID":"6a64b45d-291b-448f-a9e6-4d502a67b547","Type":"ContainerStarted","Data":"f170619d23124b0ab02713ce5d40120989eacc4d1006e6a047904f1c73c8abe7"}
Oct 30 20:35:30.639772 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.639743    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:35:30.644378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.644358    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.696819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.696799    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:35:30.697041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.697023    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hsn45\""
Oct 30 20:35:30.721813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.721792    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.721898 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.721819    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.721898 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.721849    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.721947    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.721990    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.722021    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.722054    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmknb\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.722141    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.722176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.722166    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.748034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.748013    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:35:30.823430 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823402    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823451    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmknb\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823485    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823502    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823545    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823567    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823617    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823658    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823680    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823839    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823939    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.823976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.823963    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.824284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.824240    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.824452 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.824402    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.825955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.825935    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.826068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.826052    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.887737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.887710    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.887835 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.887795    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmknb\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\") pod \"maas-default-gateway-openshift-default-58847f9fc5-rsxpk\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:30.957970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:30.957904    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:31.146418 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:31.146385    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl" event={"ID":"6a64b45d-291b-448f-a9e6-4d502a67b547","Type":"ContainerStarted","Data":"b33e0f42fb6551de64570d150b42e07b974c9b84e1a61811307adda0f7699550"}
Oct 30 20:35:31.266497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:31.266415    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl" podStartSLOduration=1.68688525 podStartE2EDuration="2.266401125s" totalImagesPullingTime="579.515875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:31.264757352 +0000 UTC m=+497.256760480" watchObservedRunningTime="2026-10-30 20:35:31.266401125 +0000 UTC m=+497.258404252"
Oct 30 20:35:31.385112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:31.385074    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:35:31.389098 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:31.389069    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7da9f4_7ad7_4a0a_8940_5d774a3bae15.slice/crio-c07fc936af4d7aa1a17a7de3f50b9f06d475c070fe2dedea5cd7bdf1b1e1188e WatchSource:0}: Error finding container c07fc936af4d7aa1a17a7de3f50b9f06d475c070fe2dedea5cd7bdf1b1e1188e: Status 404 returned error can't find the container with id c07fc936af4d7aa1a17a7de3f50b9f06d475c070fe2dedea5cd7bdf1b1e1188e
Oct 30 20:35:31.731088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:31.731063    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:32.153073 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:32.153036    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" event={"ID":"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15","Type":"ContainerStarted","Data":"c07fc936af4d7aa1a17a7de3f50b9f06d475c070fe2dedea5cd7bdf1b1e1188e"}
Oct 30 20:35:32.652483 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:32.652447    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:32.665067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:32.665042    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:33.176106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:33.176072    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vpvxp"
Oct 30 20:35:35.813242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:35.813196    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:35:35.813611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:35.813299    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:35:35.813611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:35.813344    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:35:36.184602 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.184558    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" event={"ID":"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15","Type":"ContainerStarted","Data":"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"}
Oct 30 20:35:36.347634 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.347581    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podStartSLOduration=1.926375734 podStartE2EDuration="6.347564387s" totalImagesPullingTime="4.421188653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:36.346605425 +0000 UTC m=+502.338608630" watchObservedRunningTime="2026-10-30 20:35:36.347564387 +0000 UTC m=+502.339567514"
Oct 30 20:35:36.574870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.574789    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:36.587652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.587621    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:36.820548 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.820511    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mn78n"]
Oct 30 20:35:36.824471 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.824438    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.878016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.877974    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 20:35:36.920945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.915888    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mn78n"]
Oct 30 20:35:36.928560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.928530    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff48eb3-c498-4663-a094-7f4fed6b8027-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.928790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.928769    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw5bb\" (UniqueName: \"kubernetes.io/projected/eff48eb3-c498-4663-a094-7f4fed6b8027-kube-api-access-vw5bb\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.928934 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.928901    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.929057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.929041    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-home\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.929165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.929152    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.929278 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.929266    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:36.958100 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.958059    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:36.959363 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.959338    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:36.959489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:36.959391    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:37.030042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.029999    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030138    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff48eb3-c498-4663-a094-7f4fed6b8027-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030157    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw5bb\" (UniqueName: \"kubernetes.io/projected/eff48eb3-c498-4663-a094-7f4fed6b8027-kube-api-access-vw5bb\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030180    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030197    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-home\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030213    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.030510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.030467    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.031310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.031258    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-home\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.031752 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.031728    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.032487 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.032469    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff48eb3-c498-4663-a094-7f4fed6b8027-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.033687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.033665    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff48eb3-c498-4663-a094-7f4fed6b8027-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.103783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.103707    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw5bb\" (UniqueName: \"kubernetes.io/projected/eff48eb3-c498-4663-a094-7f4fed6b8027-kube-api-access-vw5bb\") pod \"echo-simulator-kserve-64b6f8f96c-mn78n\" (UID: \"eff48eb3-c498-4663-a094-7f4fed6b8027\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.162709 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.162678    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:37.234946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.234866    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-s2fhj"
Oct 30 20:35:37.559205 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.559172    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mn78n"]
Oct 30 20:35:37.563606 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:35:37.563582    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff48eb3_c498_4663_a094_7f4fed6b8027.slice/crio-9ac0cb7d0e25adb3282852509cf621f2d254ba0e0bcd2db4b0760cd00ec1c5c8 WatchSource:0}: Error finding container 9ac0cb7d0e25adb3282852509cf621f2d254ba0e0bcd2db4b0760cd00ec1c5c8: Status 404 returned error can't find the container with id 9ac0cb7d0e25adb3282852509cf621f2d254ba0e0bcd2db4b0760cd00ec1c5c8
Oct 30 20:35:37.958743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.958707    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:37.959146 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:37.958765    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:38.220605 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:38.220520    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n" event={"ID":"eff48eb3-c498-4663-a094-7f4fed6b8027","Type":"ContainerStarted","Data":"9ac0cb7d0e25adb3282852509cf621f2d254ba0e0bcd2db4b0760cd00ec1c5c8"}
Oct 30 20:35:38.959252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:38.959222    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:38.959729 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:38.959285    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:39.731520 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:39.731475    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:39.744435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:39.744412    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:39.959133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:39.959094    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:39.959301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:39.959204    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:40.241971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:40.241910    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-gz8hl"
Oct 30 20:35:40.958818 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:40.958782    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:40.959016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:40.958841    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:41.240862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:41.240764    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n" event={"ID":"eff48eb3-c498-4663-a094-7f4fed6b8027","Type":"ContainerStarted","Data":"b497900cf628365896e05add8213d4bd23c31c836cfc21f876a33255abafcc83"}
Oct 30 20:35:41.371527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:41.371475    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n" podStartSLOduration=2.6670074870000002 podStartE2EDuration="5.371461782s" totalImagesPullingTime="2.704454295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:41.370002553 +0000 UTC m=+507.362005677" watchObservedRunningTime="2026-10-30 20:35:41.371461782 +0000 UTC m=+507.363464906"
Oct 30 20:35:41.958457 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:41.958413    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:41.958619 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:41.958477    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:42.163902 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:42.163864    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:42.958756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:42.958720    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-rsxpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 20:35:42.959173 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:42.958781    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 20:35:43.962212 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:43.962183    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:43.962683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:43.962448    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:43.963135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:43.963117    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:35:47.162985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:47.162951    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:47.180311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:47.180287    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:47.279791 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:35:47.279763    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n"
Oct 30 20:35:49.516193 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:35:49.516151    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:36:04.672283 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.672244    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5849dbdbbb-l5k9d"]
Oct 30 20:36:04.675681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.675660    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.695083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.695060    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694b600-45a9-457c-9e5c-2816c8563225-tls-cert\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.695172 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.695087    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxkl\" (UniqueName: \"kubernetes.io/projected/b694b600-45a9-457c-9e5c-2816c8563225-kube-api-access-jdxkl\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.733172 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.733148    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5849dbdbbb-l5k9d"]
Oct 30 20:36:04.796319 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.796290    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694b600-45a9-457c-9e5c-2816c8563225-tls-cert\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.796419 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.796324    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxkl\" (UniqueName: \"kubernetes.io/projected/b694b600-45a9-457c-9e5c-2816c8563225-kube-api-access-jdxkl\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.798887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.798868    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694b600-45a9-457c-9e5c-2816c8563225-tls-cert\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.813015 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.812995    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:04.816257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.816243    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:04.858895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.858872    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxkl\" (UniqueName: \"kubernetes.io/projected/b694b600-45a9-457c-9e5c-2816c8563225-kube-api-access-jdxkl\") pod \"authorino-5849dbdbbb-l5k9d\" (UID: \"b694b600-45a9-457c-9e5c-2816c8563225\") " pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.869881 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.869853    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 20:36:04.869881 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.869862    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 20:36:04.870038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.869906    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 20:36:04.870038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.869976    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-sgh8c\""
Oct 30 20:36:04.875605 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.875584    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:04.896970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.896952    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:04.897057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.896997    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bpk\" (UniqueName: \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:04.969865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.969813    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 20:36:04.987106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.987081    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5849dbdbbb-l5k9d"
Oct 30 20:36:04.998322 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.998303    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:04.998371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:04.998346    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28bpk\" (UniqueName: \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:04.998501 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:04.998480    5446 secret.go:189] Couldn't get secret opendatahub/ai-gateway-controller-metrics-tls: secret "ai-gateway-controller-metrics-tls" not found
Oct 30 20:36:04.998617 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:04.998555    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs podName:371c96d1-8ba5-4c5b-baeb-235d39a15e52 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:05.498534803 +0000 UTC m=+531.490537926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs") pod "ai-gateway-controller-5f6dd4f69f-hgqh8" (UID: "371c96d1-8ba5-4c5b-baeb-235d39a15e52") : secret "ai-gateway-controller-metrics-tls" not found
Oct 30 20:36:05.058611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:05.058554    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bpk\" (UniqueName: \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:05.357210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:05.357135    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5849dbdbbb-l5k9d"]
Oct 30 20:36:05.360326 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:36:05.360302    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb694b600_45a9_457c_9e5c_2816c8563225.slice/crio-e3864b0fff2d8f96abdebf12bb90b6e0d4a1264f529217d572c5d4e556f10481 WatchSource:0}: Error finding container e3864b0fff2d8f96abdebf12bb90b6e0d4a1264f529217d572c5d4e556f10481: Status 404 returned error can't find the container with id e3864b0fff2d8f96abdebf12bb90b6e0d4a1264f529217d572c5d4e556f10481
Oct 30 20:36:05.503466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:05.503440    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:05.505851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:05.505832    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-hgqh8\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:05.728179 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:05.728158    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:06.102135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:06.101936    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:06.104690 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:36:06.104667    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371c96d1_8ba5_4c5b_baeb_235d39a15e52.slice/crio-a454b30cbab9366da9c568e554f7543c4de26d19724c89268c174ce4e5c1319e WatchSource:0}: Error finding container a454b30cbab9366da9c568e554f7543c4de26d19724c89268c174ce4e5c1319e: Status 404 returned error can't find the container with id a454b30cbab9366da9c568e554f7543c4de26d19724c89268c174ce4e5c1319e
Oct 30 20:36:06.360115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:06.360038    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" event={"ID":"371c96d1-8ba5-4c5b-baeb-235d39a15e52","Type":"ContainerStarted","Data":"a454b30cbab9366da9c568e554f7543c4de26d19724c89268c174ce4e5c1319e"}
Oct 30 20:36:06.361195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:06.361174    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5849dbdbbb-l5k9d" event={"ID":"b694b600-45a9-457c-9e5c-2816c8563225","Type":"ContainerStarted","Data":"e3864b0fff2d8f96abdebf12bb90b6e0d4a1264f529217d572c5d4e556f10481"}
Oct 30 20:36:07.368467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.368421    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5849dbdbbb-l5k9d" event={"ID":"b694b600-45a9-457c-9e5c-2816c8563225","Type":"ContainerStarted","Data":"11bee831ec3a420d56355dec3899b712d1cac46109b888ec061ecb8a640a5800"}
Oct 30 20:36:07.486572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.485996    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5849dbdbbb-l5k9d" podStartSLOduration=1.921840153 podStartE2EDuration="3.485981017s" totalImagesPullingTime="1.564140864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:07.483784879 +0000 UTC m=+533.475788006" watchObservedRunningTime="2026-10-30 20:36:07.485981017 +0000 UTC m=+533.477984144"
Oct 30 20:36:07.535716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.535663    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:36:07.535990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.535959    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" podUID="2278894d-2743-4086-be12-93936cc8887b" containerName="authorino" containerID="cri-o://1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d" gracePeriod=30
Oct 30 20:36:07.784935 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.784888    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:36:07.823042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.823005    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\" (UniqueName: \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\") pod \"2278894d-2743-4086-be12-93936cc8887b\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") "
Oct 30 20:36:07.823212 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.823101    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\" (UniqueName: \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\") pod \"2278894d-2743-4086-be12-93936cc8887b\" (UID: \"2278894d-2743-4086-be12-93936cc8887b\") "
Oct 30 20:36:07.826353 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.826322    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp" pod "2278894d-2743-4086-be12-93936cc8887b" (UID: "2278894d-2743-4086-be12-93936cc8887b"). InnerVolumeSpecName "kube-api-access-z8ldp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:07.839112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.839076    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert" pod "2278894d-2743-4086-be12-93936cc8887b" (UID: "2278894d-2743-4086-be12-93936cc8887b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:07.924739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.924646    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8ldp\" (UniqueName: \"kubernetes.io/projected/2278894d-2743-4086-be12-93936cc8887b-kube-api-access-z8ldp\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:36:07.924739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:07.924686    5446 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2278894d-2743-4086-be12-93936cc8887b-tls-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:36:08.375977 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.375945    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" event={"ID":"371c96d1-8ba5-4c5b-baeb-235d39a15e52","Type":"ContainerStarted","Data":"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"}
Oct 30 20:36:08.376443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.376052    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:08.377299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.377276    5446 generic.go:356] "Generic (PLEG): container finished" podID="2278894d-2743-4086-be12-93936cc8887b" containerID="1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d" exitCode=0
Oct 30 20:36:08.377412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.377311    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd"
Oct 30 20:36:08.377412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.377353    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" event={"ID":"2278894d-2743-4086-be12-93936cc8887b","Type":"ContainerDied","Data":"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"}
Oct 30 20:36:08.377412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.377384    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9464b5-pk6vd" event={"ID":"2278894d-2743-4086-be12-93936cc8887b","Type":"ContainerDied","Data":"6cbd61c183e2e0cf482d4d994590dfe422ceccd15d3b95d149c20602af1a3181"}
Oct 30 20:36:08.377412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.377403    5446 scope.go:122] "RemoveContainer" containerID="1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"
Oct 30 20:36:08.386069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.386051    5446 scope.go:122] "RemoveContainer" containerID="1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"
Oct 30 20:36:08.392948 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:08.388316    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d\": container with ID starting with 1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d not found: ID does not exist" containerID="1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"
Oct 30 20:36:08.392948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.388385    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d"} err="failed to get container status \"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d\": rpc error: code = NotFound desc = could not find container \"1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d\": container with ID starting with 1e61dd91d2d9b54c1463ae2d55647f29faa0d5afb81648fba837258d9878078d not found: ID does not exist"
Oct 30 20:36:08.492521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.492464    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" podStartSLOduration=2.3191843309999998 podStartE2EDuration="4.49244956s" totalImagesPullingTime="2.173265229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:08.490816952 +0000 UTC m=+534.482820073" watchObservedRunningTime="2026-10-30 20:36:08.49244956 +0000 UTC m=+534.484452681"
Oct 30 20:36:08.603528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.603453    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:36:08.608895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:08.608865    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c6b9464b5-pk6vd"]
Oct 30 20:36:10.119684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:10.119647    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2278894d-2743-4086-be12-93936cc8887b" path="/var/lib/kubelet/pods/2278894d-2743-4086-be12-93936cc8887b/volumes"
Oct 30 20:36:12.706602 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.706565    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-5776v"]
Oct 30 20:36:12.707008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.706974    5446 cpu_manager.go:414] "containerMap: removing container" podUID="2278894d-2743-4086-be12-93936cc8887b" containerName="authorino"
Oct 30 20:36:12.707008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.706985    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2278894d-2743-4086-be12-93936cc8887b" containerName="authorino"
Oct 30 20:36:12.707086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.707050    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="2278894d-2743-4086-be12-93936cc8887b" containerName="authorino"
Oct 30 20:36:12.715970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.715950    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.771657 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.771630    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-5776v"]
Oct 30 20:36:12.788683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.788663    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhtw\" (UniqueName: \"kubernetes.io/projected/4fbaa887-b5fb-468a-90ba-950f14b3eea9-kube-api-access-srhtw\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.788801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.788786    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fbaa887-b5fb-468a-90ba-950f14b3eea9-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.819165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.819138    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 20:36:12.819316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.819286    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lvjzv\""
Oct 30 20:36:12.884002 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.883964    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-fq798"]
Oct 30 20:36:12.887878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.887855    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:12.889329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.889306    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fbaa887-b5fb-468a-90ba-950f14b3eea9-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.889466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.889353    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srhtw\" (UniqueName: \"kubernetes.io/projected/4fbaa887-b5fb-468a-90ba-950f14b3eea9-kube-api-access-srhtw\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.890150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.890117    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fbaa887-b5fb-468a-90ba-950f14b3eea9-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.944610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.944582    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-fq798"]
Oct 30 20:36:12.948783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.948760    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhtw\" (UniqueName: \"kubernetes.io/projected/4fbaa887-b5fb-468a-90ba-950f14b3eea9-kube-api-access-srhtw\") pod \"payload-pre-processing-7b98bb678c-5776v\" (UID: \"4fbaa887-b5fb-468a-90ba-950f14b3eea9\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:12.989970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.989872    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-plugins-config-volume\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:12.989970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:12.989905    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjbf\" (UniqueName: \"kubernetes.io/projected/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-kube-api-access-zpjbf\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.028685 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.028657    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:13.090884 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.090841    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-plugins-config-volume\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.091038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.090896    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjbf\" (UniqueName: \"kubernetes.io/projected/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-kube-api-access-zpjbf\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.091936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.091888    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-plugins-config-volume\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.151085 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.151048    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjbf\" (UniqueName: \"kubernetes.io/projected/e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa-kube-api-access-zpjbf\") pod \"payload-processing-5f78687d5b-fq798\" (UID: \"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa\") " pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.200808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.200784    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:13.405099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.405067    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-5776v"]
Oct 30 20:36:13.408193 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:36:13.408166    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbaa887_b5fb_468a_90ba_950f14b3eea9.slice/crio-d86c541e726c8df9acf0660f2bb599e2f35a8da87bdcd8cf10bfeb898db18c12 WatchSource:0}: Error finding container d86c541e726c8df9acf0660f2bb599e2f35a8da87bdcd8cf10bfeb898db18c12: Status 404 returned error can't find the container with id d86c541e726c8df9acf0660f2bb599e2f35a8da87bdcd8cf10bfeb898db18c12
Oct 30 20:36:13.580949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:13.580904    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-fq798"]
Oct 30 20:36:13.583420 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:36:13.583391    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ddc402_f3e6_49b6_bc35_e1de7c2ca4aa.slice/crio-10941669dc82b346d4d933f134d3c61c80db5f26ab5ed27b527eaa58dc330fc9 WatchSource:0}: Error finding container 10941669dc82b346d4d933f134d3c61c80db5f26ab5ed27b527eaa58dc330fc9: Status 404 returned error can't find the container with id 10941669dc82b346d4d933f134d3c61c80db5f26ab5ed27b527eaa58dc330fc9
Oct 30 20:36:14.407540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:14.407500    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v" event={"ID":"4fbaa887-b5fb-468a-90ba-950f14b3eea9","Type":"ContainerStarted","Data":"d86c541e726c8df9acf0660f2bb599e2f35a8da87bdcd8cf10bfeb898db18c12"}
Oct 30 20:36:14.408667 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:14.408643    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-fq798" event={"ID":"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa","Type":"ContainerStarted","Data":"10941669dc82b346d4d933f134d3c61c80db5f26ab5ed27b527eaa58dc330fc9"}
Oct 30 20:36:17.427690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.427651    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-fq798" event={"ID":"e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa","Type":"ContainerStarted","Data":"85976dc29dfbf6dd5e58307610c3ba77724aeacea6a20c997c74562672f13572"}
Oct 30 20:36:17.428167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.427725    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:17.429163 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.429143    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v" event={"ID":"4fbaa887-b5fb-468a-90ba-950f14b3eea9","Type":"ContainerStarted","Data":"053f01aebaad1d048f295d84166bf3407080ca7700fddaef2aa212d9c60aa004"}
Oct 30 20:36:17.429289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.429274    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:17.551295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.551249    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-fq798" podStartSLOduration=2.769974162 podStartE2EDuration="5.551237335s" totalImagesPullingTime="2.781263173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:17.548969552 +0000 UTC m=+543.540972676" watchObservedRunningTime="2026-10-30 20:36:17.551237335 +0000 UTC m=+543.543240477"
Oct 30 20:36:17.668182 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:17.668129    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v" podStartSLOduration=2.512449837 podStartE2EDuration="5.668113723s" totalImagesPullingTime="3.155663886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:17.667301596 +0000 UTC m=+543.659304722" watchObservedRunningTime="2026-10-30 20:36:17.668113723 +0000 UTC m=+543.660116847"
Oct 30 20:36:19.385299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.385273    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:19.515450 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:19.515417    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:36:19.759001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.758911    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5574f9c87-txzj9"]
Oct 30 20:36:19.762481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.762464    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:19.820854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.820820    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5574f9c87-txzj9"]
Oct 30 20:36:19.858457 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.858427    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73088761-92a4-4823-9436-d0e91e9add3b-metrics-certs\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:19.858571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.858484    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrcz\" (UniqueName: \"kubernetes.io/projected/73088761-92a4-4823-9436-d0e91e9add3b-kube-api-access-znrcz\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:19.959839 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.959808    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrcz\" (UniqueName: \"kubernetes.io/projected/73088761-92a4-4823-9436-d0e91e9add3b-kube-api-access-znrcz\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:19.959983 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.959940    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73088761-92a4-4823-9436-d0e91e9add3b-metrics-certs\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:19.962416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:19.962391    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73088761-92a4-4823-9436-d0e91e9add3b-metrics-certs\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:20.018142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:20.018090    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrcz\" (UniqueName: \"kubernetes.io/projected/73088761-92a4-4823-9436-d0e91e9add3b-kube-api-access-znrcz\") pod \"ai-gateway-controller-5574f9c87-txzj9\" (UID: \"73088761-92a4-4823-9436-d0e91e9add3b\") " pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:20.074394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:20.074365    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:20.450706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:20.450671    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5574f9c87-txzj9"]
Oct 30 20:36:20.456845 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:36:20.456813    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73088761_92a4_4823_9436_d0e91e9add3b.slice/crio-040292c43a8aefa522a182b6af516f6783a046f7600fd6a0323b0b8ec849cff8 WatchSource:0}: Error finding container 040292c43a8aefa522a182b6af516f6783a046f7600fd6a0323b0b8ec849cff8: Status 404 returned error can't find the container with id 040292c43a8aefa522a182b6af516f6783a046f7600fd6a0323b0b8ec849cff8
Oct 30 20:36:21.451581 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:21.451547    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9" event={"ID":"73088761-92a4-4823-9436-d0e91e9add3b","Type":"ContainerStarted","Data":"5c7578e419ecc463161708af2266f21ad11da7a3ac4d5159f8df24136ea1726d"}
Oct 30 20:36:21.452001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:21.451606    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9" event={"ID":"73088761-92a4-4823-9436-d0e91e9add3b","Type":"ContainerStarted","Data":"040292c43a8aefa522a182b6af516f6783a046f7600fd6a0323b0b8ec849cff8"}
Oct 30 20:36:21.452001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:21.451657    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:21.567606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:21.567511    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9" podStartSLOduration=1.779457402 podStartE2EDuration="2.567498873s" totalImagesPullingTime="788.041471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:21.565480633 +0000 UTC m=+547.557483760" watchObservedRunningTime="2026-10-30 20:36:21.567498873 +0000 UTC m=+547.559501999"
Oct 30 20:36:28.437461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:28.437391    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-5776v"
Oct 30 20:36:28.437810 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:28.437543    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-fq798"
Oct 30 20:36:32.459074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.459045    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5574f9c87-txzj9"
Oct 30 20:36:32.626190 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.626158    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:32.626408 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.626385    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" podUID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" containerName="manager" containerID="cri-o://bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51" gracePeriod=30
Oct 30 20:36:32.864086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.864065    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:32.964612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.964584    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\" (UniqueName: \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\") pod \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") "
Oct 30 20:36:32.964749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.964681    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") pod \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\" (UID: \"371c96d1-8ba5-4c5b-baeb-235d39a15e52\") "
Oct 30 20:36:32.966884 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.966860    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk" pod "371c96d1-8ba5-4c5b-baeb-235d39a15e52" (UID: "371c96d1-8ba5-4c5b-baeb-235d39a15e52"). InnerVolumeSpecName "kube-api-access-28bpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:32.966980 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:32.966888    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs" pod "371c96d1-8ba5-4c5b-baeb-235d39a15e52" (UID: "371c96d1-8ba5-4c5b-baeb-235d39a15e52"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:33.065671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.065616    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371c96d1-8ba5-4c5b-baeb-235d39a15e52-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:36:33.065671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.065640    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28bpk\" (UniqueName: \"kubernetes.io/projected/371c96d1-8ba5-4c5b-baeb-235d39a15e52-kube-api-access-28bpk\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:36:33.520576 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.520548    5446 generic.go:356] "Generic (PLEG): container finished" podID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" containerID="bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51" exitCode=0
Oct 30 20:36:33.521003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.520588    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"
Oct 30 20:36:33.521003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.520634    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" event={"ID":"371c96d1-8ba5-4c5b-baeb-235d39a15e52","Type":"ContainerDied","Data":"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"}
Oct 30 20:36:33.521003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.520679    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8" event={"ID":"371c96d1-8ba5-4c5b-baeb-235d39a15e52","Type":"ContainerDied","Data":"a454b30cbab9366da9c568e554f7543c4de26d19724c89268c174ce4e5c1319e"}
Oct 30 20:36:33.521003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.520700    5446 scope.go:122] "RemoveContainer" containerID="bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"
Oct 30 20:36:33.529830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.529817    5446 scope.go:122] "RemoveContainer" containerID="bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"
Oct 30 20:36:33.530125 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:33.530105    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51\": container with ID starting with bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51 not found: ID does not exist" containerID="bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"
Oct 30 20:36:33.530168 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.530134    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51"} err="failed to get container status \"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51\": rpc error: code = NotFound desc = could not find container \"bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51\": container with ID starting with bf118acbb30fea54b7d8e96726f06accf04fbebbad27f7cc4de21c15435f3d51 not found: ID does not exist"
Oct 30 20:36:33.689161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.689138    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:33.738087 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:33.738055    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-hgqh8"]
Oct 30 20:36:34.120612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:36:34.120580    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" path="/var/lib/kubelet/pods/371c96d1-8ba5-4c5b-baeb-235d39a15e52/volumes"
Oct 30 20:36:49.515096 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:36:49.515061    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:37:09.942902 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:09.942872    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:37:09.943350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:09.943257    5446 cpu_manager.go:414] "containerMap: removing container" podUID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" containerName="manager"
Oct 30 20:37:09.943350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:09.943269    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" containerName="manager"
Oct 30 20:37:09.943350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:09.943340    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="371c96d1-8ba5-4c5b-baeb-235d39a15e52" containerName="manager"
Oct 30 20:37:09.946546 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:09.946529    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.046780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.046750    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:37:10.055331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.055312    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-86d620-openshift-default-dockercfg-b92ff\""
Oct 30 20:37:10.073257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073231    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073280    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073303    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073409    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073429    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073507    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073541    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073577    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbn88\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.073690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.073674    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175044    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175098    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbn88\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175141    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175185    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175233    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175262    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175311    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175340    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175588 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175382    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175641    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175728 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175684    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175731    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.175843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.175806    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.176093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.176072    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.177579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.177562    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.177725 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.177702    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.254845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.254792    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.255082 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.255052    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbn88\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.258857 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.258843    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:10.262095 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.262074    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 20:37:10.265698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.265681    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.320265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.320243    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-ee3fad-openshift-default-dockercfg-tzrhl\""
Oct 30 20:37:10.330517 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.330493    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 20:37:10.377938 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.377891    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.377938 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.377938    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378010    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfqh\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378032    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378064    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378103    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378138    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378226    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.378276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.378247    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478833 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478803    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478840    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478883    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478901    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478948    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfqh\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.478998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.478975    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479026    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479052    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479084    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479259    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479299    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479435    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479512    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.479910 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.479878    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.481281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.481263    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.481378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.481363    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.537910 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.537865    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.538024 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.538008    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfqh\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.588980 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.588951    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:10.589737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.589718    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:37:10.593202 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.593192    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.647482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.647454    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-f6ebf5-openshift-default-dockercfg-hsckc\""
Oct 30 20:37:10.660042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.659934    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:37:10.681412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681373    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681426    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681475    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681550    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681634    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgpww\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681678    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681804 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681716    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681829    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.681903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.681862    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.686909 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.686884    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:37:10.690878 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:10.690852    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ce08fb_ea2f_4937_b9a6_d187bdb08647.slice/crio-6a22d581a2f69ea1533099c9daf3d4344698c0b8563985d4df6182b1a5fd2040 WatchSource:0}: Error finding container 6a22d581a2f69ea1533099c9daf3d4344698c0b8563985d4df6182b1a5fd2040: Status 404 returned error can't find the container with id 6a22d581a2f69ea1533099c9daf3d4344698c0b8563985d4df6182b1a5fd2040
Oct 30 20:37:10.692967 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.692907    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:10.693049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.693001    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:10.693049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.693029    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:10.783213 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783178    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783251    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783301    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783347    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783376    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783449    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783484    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgpww\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783509    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783540    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.783719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783669    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.784242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.783951    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.784242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.784001    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.784242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.784196    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.784242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.784234    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.786588 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.786564    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.786797 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.786779    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.858722 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.858644    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgpww\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.858893 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.858808    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.906622 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.906589    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:10.969795 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.969762    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 20:37:10.977678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.977648    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:10.988075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.986317    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 20:37:10.990763 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:10.990732    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef46e2a7_c916_4e37_9879_890f49b172b6.slice/crio-5b5eb4b9b15b096fe7c2ba97110be29714869683478523903ef47d69ae189b4e WatchSource:0}: Error finding container 5b5eb4b9b15b096fe7c2ba97110be29714869683478523903ef47d69ae189b4e: Status 404 returned error can't find the container with id 5b5eb4b9b15b096fe7c2ba97110be29714869683478523903ef47d69ae189b4e
Oct 30 20:37:10.993590 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.993547    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:10.993688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.993638    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:10.993688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:10.993679    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.032578 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.032556    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-395022-openshift-default-dockercfg-7nmw8\""
Oct 30 20:37:11.045944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.045901    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 20:37:11.086811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.086780    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.086993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.086835    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.086993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.086866    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9znzn\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087123 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087024    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087123 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087074    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087225 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087133    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087234    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087277    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.087387 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.087307    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188779 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188751    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188796    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188830    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188864    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188881    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188907    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.188963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188946    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.188992    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189025    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9znzn\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189177    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189434 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189281    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189501 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189470    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189553    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.189658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.189627    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.191403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.191380    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.191528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.191508    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.247514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.247488    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9znzn\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.247648 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.247627    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-qlth2\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.290130 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.290106    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:37:11.291512 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.291492    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 20:37:11.293703 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:11.293667    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29340b3a_b50c_4d12_b5df_39b1593f84a0.slice/crio-c005f1607ad32969f8d2510af0dfeaecc1c1876a7c1f484f60e623758667e313 WatchSource:0}: Error finding container c005f1607ad32969f8d2510af0dfeaecc1c1876a7c1f484f60e623758667e313: Status 404 returned error can't find the container with id c005f1607ad32969f8d2510af0dfeaecc1c1876a7c1f484f60e623758667e313
Oct 30 20:37:11.296296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.296269    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.296391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.296327    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.296391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.296359    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.296519 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.296503    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.301492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.301308    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:11.351678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.351640    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-386743-openshift-default-dockercfg-zfbp9\""
Oct 30 20:37:11.357744 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.357640    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391549    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391583    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391618    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391788    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjw86\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391842    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391861    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.391893    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.392005    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.393317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.392035    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.492750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492667    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.492750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492717    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.492955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492823    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.492955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492891    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.492955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492934    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.492979    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493105 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493080    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjw86\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493157 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493128    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493153    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493334 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493270    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493336    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493404    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493586 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493568    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.493621 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.493591    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.495285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.495263    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.495454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.495439    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.553516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.553485    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.554308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.554292    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjw86\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.629433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.629407    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:11.701248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.701004    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerStarted","Data":"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"}
Oct 30 20:37:11.701248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.701083    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerStarted","Data":"5b5eb4b9b15b096fe7c2ba97110be29714869683478523903ef47d69ae189b4e"}
Oct 30 20:37:11.703202 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.702758    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerStarted","Data":"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"}
Oct 30 20:37:11.703202 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.702806    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerStarted","Data":"c005f1607ad32969f8d2510af0dfeaecc1c1876a7c1f484f60e623758667e313"}
Oct 30 20:37:11.705048 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.705020    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerStarted","Data":"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"}
Oct 30 20:37:11.705143 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.705078    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerStarted","Data":"6a22d581a2f69ea1533099c9daf3d4344698c0b8563985d4df6182b1a5fd2040"}
Oct 30 20:37:11.718258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.718237    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 20:37:11.720664 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:11.720643    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f20541_9b06_4fcd_bf7d_24b0891a353b.slice/crio-a04001eba4518424e9a1a3f98feaab2d2d15539f78c7a5a71a95745bb57746a5 WatchSource:0}: Error finding container a04001eba4518424e9a1a3f98feaab2d2d15539f78c7a5a71a95745bb57746a5: Status 404 returned error can't find the container with id a04001eba4518424e9a1a3f98feaab2d2d15539f78c7a5a71a95745bb57746a5
Oct 30 20:37:11.723657 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.723628    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.723756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.723698    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.723756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.723744    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:11.828087 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.827885    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podStartSLOduration=1.827866814 podStartE2EDuration="1.827866814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:11.826968824 +0000 UTC m=+597.818971950" watchObservedRunningTime="2026-10-30 20:37:11.827866814 +0000 UTC m=+597.819869943"
Oct 30 20:37:11.907378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.907353    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:11.976435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:11.976377    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podStartSLOduration=2.976359799 podStartE2EDuration="2.976359799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:11.975127466 +0000 UTC m=+597.967130593" watchObservedRunningTime="2026-10-30 20:37:11.976359799 +0000 UTC m=+597.968363010"
Oct 30 20:37:12.018829 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.018806    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 20:37:12.021821 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:12.021789    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b99149_6731_4c7f_9362_ec3d95f22c89.slice/crio-e87548da3407478af2f7d638bd3d4e608b993e0b59b6a80ebddb1e446eac01da WatchSource:0}: Error finding container e87548da3407478af2f7d638bd3d4e608b993e0b59b6a80ebddb1e446eac01da: Status 404 returned error can't find the container with id e87548da3407478af2f7d638bd3d4e608b993e0b59b6a80ebddb1e446eac01da
Oct 30 20:37:12.024153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.024123    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:12.024243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.024196    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:12.024310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.024242    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:12.113937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.110946    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podStartSLOduration=2.110910789 podStartE2EDuration="2.110910789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:12.107039421 +0000 UTC m=+598.099042547" watchObservedRunningTime="2026-10-30 20:37:12.110910789 +0000 UTC m=+598.102913919"
Oct 30 20:37:12.259826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.259792    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:12.264804 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.264779    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:12.589641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.589611    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:12.594714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.594692    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:12.711903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.711870    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerStarted","Data":"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"}
Oct 30 20:37:12.712050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.711949    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerStarted","Data":"a04001eba4518424e9a1a3f98feaab2d2d15539f78c7a5a71a95745bb57746a5"}
Oct 30 20:37:12.713558 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.713528    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerStarted","Data":"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"}
Oct 30 20:37:12.713684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.713571    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerStarted","Data":"e87548da3407478af2f7d638bd3d4e608b993e0b59b6a80ebddb1e446eac01da"}
Oct 30 20:37:12.714053 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.714025    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:12.714160 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.714070    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:12.714685 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.714663    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:37:12.715483 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.715462    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:12.835214 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.835166    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podStartSLOduration=2.835153362 podStartE2EDuration="2.835153362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:12.834009045 +0000 UTC m=+598.826012171" watchObservedRunningTime="2026-10-30 20:37:12.835153362 +0000 UTC m=+598.827156489"
Oct 30 20:37:12.912820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.912799    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:12.961217 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:12.961074    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podStartSLOduration=1.961056976 podStartE2EDuration="1.961056976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:12.958871099 +0000 UTC m=+598.950874228" watchObservedRunningTime="2026-10-30 20:37:12.961056976 +0000 UTC m=+598.953060104"
Oct 30 20:37:13.302258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.302187    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:13.307050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.307030    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:13.630406 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.630379    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:13.635513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.635491    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:13.718240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.718213    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:13.718702 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.718672    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:13.718825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.718743    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:13.719129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.719110    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:13.719362 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.719347    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:37:13.719896 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:13.719885    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:37:19.515223 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:19.515187    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:37:21.644000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.643962    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 20:37:21.648961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.648939    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.710301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.710277    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-ee3fad-serving-cert\""
Oct 30 20:37:21.761195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.761158    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 20:37:21.788332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.788297    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.788467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.788452    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.788537 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.788508    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.788605 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.788585    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqq2c\" (UniqueName: \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.890194 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.890161    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.890392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.890221    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.890392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.890248    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqq2c\" (UniqueName: \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.890392 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:21.890326    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-serving-cert: secret "maas-api-e2e-worker-w6-ee3fad-serving-cert" not found
Oct 30 20:37:21.890392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.890342    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.890568 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:21.890438    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls podName:3c75fe46-a293-41ff-a641-19e62ad86202 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:22.390416882 +0000 UTC m=+608.382420000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls") pod "maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" (UID: "3c75fe46-a293-41ff-a641-19e62ad86202") : secret "maas-api-e2e-worker-w6-ee3fad-serving-cert" not found
Oct 30 20:37:21.890978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.890959    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.892751 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.892729    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:21.951086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:21.951026    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqq2c\" (UniqueName: \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:22.395695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:22.395666    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:22.398135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:22.398115    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:22.564391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:22.564364    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:22.941802 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:22.941781    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 20:37:22.944754 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:22.944725    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c75fe46_a293_41ff_a641_19e62ad86202.slice/crio-fbc3a36dd9992855fa9fb187cbc17d43e3fd7bcedfc949d5562d9c0c6fc8fddb WatchSource:0}: Error finding container fbc3a36dd9992855fa9fb187cbc17d43e3fd7bcedfc949d5562d9c0c6fc8fddb: Status 404 returned error can't find the container with id fbc3a36dd9992855fa9fb187cbc17d43e3fd7bcedfc949d5562d9c0c6fc8fddb
Oct 30 20:37:23.767288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:23.767256    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" event={"ID":"3c75fe46-a293-41ff-a641-19e62ad86202","Type":"ContainerStarted","Data":"fbc3a36dd9992855fa9fb187cbc17d43e3fd7bcedfc949d5562d9c0c6fc8fddb"}
Oct 30 20:37:24.773644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:24.773613    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" event={"ID":"3c75fe46-a293-41ff-a641-19e62ad86202","Type":"ContainerStarted","Data":"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"}
Oct 30 20:37:24.774054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:24.773755    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:24.892149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:24.892103    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" podStartSLOduration=2.958090592 podStartE2EDuration="3.892089975s" totalImagesPullingTime="933.999383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:24.890321468 +0000 UTC m=+610.882324594" watchObservedRunningTime="2026-10-30 20:37:24.892089975 +0000 UTC m=+610.884093107"
Oct 30 20:37:30.784774 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:30.784732    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 20:37:31.301150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.301112    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 20:37:31.312757 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.312727    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.360751 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.360724    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 20:37:31.367347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.367323    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-395022\""
Oct 30 20:37:31.367456 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.367361    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-395022-dockercfg-cjhcf\""
Oct 30 20:37:31.513511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.513473    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.513696 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.513582    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58kb5\" (UniqueName: \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.614554 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.614517    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58kb5\" (UniqueName: \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.614758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.614628    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.615326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.615308    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.675475 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.675450    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58kb5\" (UniqueName: \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\") pod \"payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:31.926963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:31.926862    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:32.314107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.314075    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 20:37:32.318695 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:32.318644    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda757e49a_f64c_4667_beba_9765dbd2669a.slice/crio-10969a61ba950e07eff8a6cbcb2ebad446c71ca767384f15ebd5114b900e48e0 WatchSource:0}: Error finding container 10969a61ba950e07eff8a6cbcb2ebad446c71ca767384f15ebd5114b900e48e0: Status 404 returned error can't find the container with id 10969a61ba950e07eff8a6cbcb2ebad446c71ca767384f15ebd5114b900e48e0
Oct 30 20:37:32.514647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.514606    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:37:32.518526 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.518503    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.529044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.529023    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pl7f\" (UniqueName: \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.529143 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.529054    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.529184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.529153    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.529233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.529212    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.581403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.581346    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-b43c84-serving-cert\""
Oct 30 20:37:32.582755 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.582731    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:37:32.629909 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.629878    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.630059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.629976    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.630137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.630061    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pl7f\" (UniqueName: \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.630137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.630097    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.630137 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:32.630109    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-serving-cert: secret "maas-api-e2e-worker-w2-b43c84-serving-cert" not found
Oct 30 20:37:32.630277 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:32.630167    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls podName:fa366927-7d3c-4595-82d5-0a75bec2f384 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:33.130152133 +0000 UTC m=+619.122155268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls") pod "maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" (UID: "fa366927-7d3c-4595-82d5-0a75bec2f384") : secret "maas-api-e2e-worker-w2-b43c84-serving-cert" not found
Oct 30 20:37:32.630729 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.630707    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.632380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.632362    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.708352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.708322    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pl7f\" (UniqueName: \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:32.827061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.827019    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" event={"ID":"a757e49a-f64c-4667-beba-9765dbd2669a","Type":"ContainerStarted","Data":"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"}
Oct 30 20:37:32.827246 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.827089    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:32.827246 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.827111    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" event={"ID":"a757e49a-f64c-4667-beba-9765dbd2669a","Type":"ContainerStarted","Data":"10969a61ba950e07eff8a6cbcb2ebad446c71ca767384f15ebd5114b900e48e0"}
Oct 30 20:37:32.941852 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:32.941786    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" podStartSLOduration=1.941772295 podStartE2EDuration="1.941772295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:32.940655335 +0000 UTC m=+618.932658463" watchObservedRunningTime="2026-10-30 20:37:32.941772295 +0000 UTC m=+618.933775438"
Oct 30 20:37:33.134537 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:33.134504    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:33.137144 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:33.137122    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:33.432066 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:33.432038    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:33.816489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:33.816445    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:37:33.818493 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:33.818463    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa366927_7d3c_4595_82d5_0a75bec2f384.slice/crio-b424a557c4a9572341f3b4ab6f392691a7da00973f1c56f86ca058e900c2509f WatchSource:0}: Error finding container b424a557c4a9572341f3b4ab6f392691a7da00973f1c56f86ca058e900c2509f: Status 404 returned error can't find the container with id b424a557c4a9572341f3b4ab6f392691a7da00973f1c56f86ca058e900c2509f
Oct 30 20:37:33.832638 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:33.832615    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" event={"ID":"fa366927-7d3c-4595-82d5-0a75bec2f384","Type":"ContainerStarted","Data":"b424a557c4a9572341f3b4ab6f392691a7da00973f1c56f86ca058e900c2509f"}
Oct 30 20:37:34.838882 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:34.838844    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" event={"ID":"fa366927-7d3c-4595-82d5-0a75bec2f384","Type":"ContainerStarted","Data":"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"}
Oct 30 20:37:34.839318 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:34.839007    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:34.968680 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:34.968575    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" podStartSLOduration=2.125271492 podStartE2EDuration="2.968560598s" totalImagesPullingTime="843.289106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:34.968066359 +0000 UTC m=+620.960069486" watchObservedRunningTime="2026-10-30 20:37:34.968560598 +0000 UTC m=+620.960563723"
Oct 30 20:37:37.792750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.792715    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 20:37:37.796870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.796851    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.882052 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.882016    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.882215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.882139    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.882215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.882166    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsxw\" (UniqueName: \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.882289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.882247    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.901519 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.901489    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-395022-serving-cert\""
Oct 30 20:37:37.906104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.906073    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 20:37:37.983204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.983167    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.983204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.983206    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsxw\" (UniqueName: \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.983463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.983258    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.983463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.983316    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.983463 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:37.983324    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-serving-cert: secret "maas-api-e2e-worker-w4-395022-serving-cert" not found
Oct 30 20:37:37.983463 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:37.983402    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls podName:4d4a354f-8717-4fd0-816b-f26707460cce nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.483382248 +0000 UTC m=+624.475385356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls") pod "maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" (UID: "4d4a354f-8717-4fd0-816b-f26707460cce") : secret "maas-api-e2e-worker-w4-395022-serving-cert" not found
Oct 30 20:37:37.983936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.983891    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:37.985930 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:37.985887    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:38.043895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:38.043827    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsxw\" (UniqueName: \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:38.488680 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:38.488649    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:38.491260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:38.491223    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:38.714390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:38.714358    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:39.088839 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.088771    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 20:37:39.092110 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:37:39.092082    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4a354f_8717_4fd0_816b_f26707460cce.slice/crio-f639059bd375ac138555039dafd22afcd34f34ab62124165fc7e709ad2a3eb63 WatchSource:0}: Error finding container f639059bd375ac138555039dafd22afcd34f34ab62124165fc7e709ad2a3eb63: Status 404 returned error can't find the container with id f639059bd375ac138555039dafd22afcd34f34ab62124165fc7e709ad2a3eb63
Oct 30 20:37:39.867825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.867796    5446 generic.go:356] "Generic (PLEG): container finished" podID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerID="d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038" exitCode=0
Oct 30 20:37:39.868081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.867872    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerDied","Data":"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"}
Oct 30 20:37:39.868363 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.868341    5446 scope.go:122] "RemoveContainer" containerID="d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"
Oct 30 20:37:39.869300 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.869275    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" event={"ID":"4d4a354f-8717-4fd0-816b-f26707460cce","Type":"ContainerStarted","Data":"f639059bd375ac138555039dafd22afcd34f34ab62124165fc7e709ad2a3eb63"}
Oct 30 20:37:39.869813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.869790    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:39.869874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.869858    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:39.869909 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:39.869895    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:40.856339 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:40.855044    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:37:40.876473 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:40.876278    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerStarted","Data":"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"}
Oct 30 20:37:40.877694 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:40.877671    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" event={"ID":"4d4a354f-8717-4fd0-816b-f26707460cce","Type":"ContainerStarted","Data":"44580afbbde07075dffca5847c18334da09bb2bb1974b9da193cf678d4deb2d6"}
Oct 30 20:37:40.877801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:40.877787    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:41.243699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:41.243613    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" podStartSLOduration=3.440468222 podStartE2EDuration="4.243590831s" totalImagesPullingTime="803.122609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:41.241389646 +0000 UTC m=+627.233392774" watchObservedRunningTime="2026-10-30 20:37:41.243590831 +0000 UTC m=+627.235593959"
Oct 30 20:37:41.600329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:41.600247    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:41.609049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:41.609016    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:37:41.609276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:41.609251    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Oct 30 20:37:42.595945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:42.592236    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:37:42.595945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:42.592294    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Oct 30 20:37:42.721944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:42.720718    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:43.592344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:43.592305    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:37:43.592632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:43.592601    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Oct 30 20:37:43.838872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:43.838840    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 20:37:44.601942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:44.598938    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:37:44.601942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:44.599010    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Oct 30 20:37:45.592322 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:45.592283    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:37:45.592949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:45.592892    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Oct 30 20:37:46.593837 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:46.593809    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:46.594939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:46.594894    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 20:37:46.888581 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:46.888543    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 20:37:49.514250 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:37:49.514168    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:37:49.969768 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.969740    5446 generic.go:356] "Generic (PLEG): container finished" podID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerID="0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488" exitCode=0
Oct 30 20:37:49.969987 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.969786    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerDied","Data":"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"}
Oct 30 20:37:49.970108 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.970095    5446 scope.go:122] "RemoveContainer" containerID="0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"
Oct 30 20:37:49.971296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.971270    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:49.971437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.971336    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:49.971437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:49.971366    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:37:50.976715 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:50.976682    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerStarted","Data":"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"}
Oct 30 20:37:51.907373 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:51.907336    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:51.907739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:51.907714    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Oct 30 20:37:51.908199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:51.907883    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Oct 30 20:37:52.910944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:52.908322    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Oct 30 20:37:52.910944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:52.908385    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Oct 30 20:37:53.961942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:53.937561    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Oct 30 20:37:53.965941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:53.962494    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Oct 30 20:37:54.910032 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:54.909998    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Oct 30 20:37:54.910310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:54.910285    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Oct 30 20:37:55.912431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:55.912393    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Oct 30 20:37:55.913080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:55.913026    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Oct 30 20:37:56.912090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:56.912055    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:56.912440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:56.912410    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:56.913649 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:56.913623    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:37:59.760044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:59.760011    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:37:59.760551 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:59.760065    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:37:59.760551 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:59.760011    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:37:59.760551 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:37:59.760157    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:38:01.098740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.098710    5446 generic.go:356] "Generic (PLEG): container finished" podID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerID="a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f" exitCode=0
Oct 30 20:38:01.099220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.098782    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerDied","Data":"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"}
Oct 30 20:38:01.099269 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.099233    5446 scope.go:122] "RemoveContainer" containerID="a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"
Oct 30 20:38:01.100578 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100558    5446 generic.go:356] "Generic (PLEG): container finished" podID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerID="c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8" exitCode=0
Oct 30 20:38:01.100683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100583    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:01.100683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100621    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerDied","Data":"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"}
Oct 30 20:38:01.100683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100644    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:01.100683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100682    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:01.101000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.100984    5446 scope.go:122] "RemoveContainer" containerID="c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"
Oct 30 20:38:01.102149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.102121    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:01.102248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.102191    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:01.102248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:01.102226    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:02.143382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.143332    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerStarted","Data":"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"}
Oct 30 20:38:02.146106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.146068    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerStarted","Data":"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"}
Oct 30 20:38:02.303302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.303081    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:38:02.303901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.303865    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:02.304136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.304099    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:02.632321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.632288    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:38:02.632707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.632610    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 20:38:02.632881 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:02.632860    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 20:38:03.303941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.302318    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:03.303941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.302381    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:03.612295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.612252    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:38:03.630793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.630334    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 20:38:03.630793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.630392    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 20:38:03.631402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.631379    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.674556 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.674512    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:38:03.721941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.721838    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-b32941-serving-cert\""
Oct 30 20:38:03.770756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.770703    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.771075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.771044    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9wg9\" (UniqueName: \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.771979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.771222    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.771979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.771344    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.872453 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.872353    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9wg9\" (UniqueName: \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.872751 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.872731    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.872905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.872890    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.873090 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:38:03.873073    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-serving-cert: secret "maas-api-e2e-worker-w0-b32941-serving-cert" not found
Oct 30 20:38:03.873764 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:38:03.873747    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls podName:2f9f5b53-fd3f-4c48-a753-db6f3ef6e116 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:04.373725695 +0000 UTC m=+650.365728813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls") pod "maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" (UID: "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116") : secret "maas-api-e2e-worker-w0-b32941-serving-cert" not found
Oct 30 20:38:03.873878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.873844    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.874019 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.873075    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.877527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.877507    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:03.964820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:03.964615    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9wg9\" (UniqueName: \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:04.310472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.310364    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:04.311117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.311081    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:04.386704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.386668    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:04.446723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.446690    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:04.559175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.559128    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:04.633944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.632401    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 20:38:04.633944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:04.632463    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 20:38:05.042942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.039563    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:38:05.186451 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.186418    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" event={"ID":"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116","Type":"ContainerStarted","Data":"6138480ca05b440a7c44ec43c5af80744635ff6d35e7c0d09f02fdcf6b7e17bb"}
Oct 30 20:38:05.307000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.305257    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:05.307000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.305315    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:05.632954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.632294    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 20:38:05.632954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:05.632352    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 20:38:06.217122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.217024    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" event={"ID":"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116","Type":"ContainerStarted","Data":"5f469a6c6044eeae761d075caef06c6006dbd2b7d3704b949cd01616b7aac80b"}
Oct 30 20:38:06.218278 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.218256    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:06.308941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.308273    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:06.308941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.308330    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:06.340941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.340398    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" podStartSLOduration=2.521336732 podStartE2EDuration="3.340364811s" totalImagesPullingTime="819.028079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:06.33947261 +0000 UTC m=+652.331475738" watchObservedRunningTime="2026-10-30 20:38:06.340364811 +0000 UTC m=+652.332367940"
Oct 30 20:38:06.630955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.630310    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 20:38:06.630955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:06.630373    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 20:38:07.309944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:07.301549    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:38:07.309944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:07.301605    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Oct 30 20:38:07.731696 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:07.731656    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:38:07.732195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:07.732132    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:38:07.733367 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:07.733342    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 20:38:08.313360 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:08.313331    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:38:08.314437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:08.314407    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:38:08.315314 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:08.315289    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 20:38:12.298539 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.298470    5446 generic.go:356] "Generic (PLEG): container finished" podID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerID="420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538" exitCode=0
Oct 30 20:38:12.298953 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.298535    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerDied","Data":"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"}
Oct 30 20:38:12.298953 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.298858    5446 scope.go:122] "RemoveContainer" containerID="420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"
Oct 30 20:38:12.300049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.300026    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:12.300109 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.300087    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:12.300142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.300126    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:12.713842 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:12.713811    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:38:13.282439 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:13.282413    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:38:13.318662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:13.318623    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerStarted","Data":"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"}
Oct 30 20:38:14.259775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:14.259745    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:38:14.260957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:14.260903    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:38:14.261097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:14.260978    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Oct 30 20:38:15.259386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:15.259351    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:38:15.259762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:15.259408    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Oct 30 20:38:16.260076 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:16.260037    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:38:16.260465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:16.260085    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Oct 30 20:38:17.260065 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:17.260035    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:38:17.260291 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:17.260271    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Oct 30 20:38:18.260040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:18.260005    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:38:18.260227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:18.260062    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Oct 30 20:38:19.263498 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:19.263470    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:38:19.264013 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:19.263861    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:38:19.264518 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:19.264497    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:38:19.515258 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:38:19.515183    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:38:43.610663 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.610630    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:38:43.613665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.613650    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.667641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.667614    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b43c84\"/\"openshift-service-ca.crt\""
Oct 30 20:38:43.715368 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.715335    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b43c84\"/\"kube-root-ca.crt\""
Oct 30 20:38:43.715504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.715384    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b43c84\"/\"default-dockercfg-jgd8f\""
Oct 30 20:38:43.715504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.715433    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b43c84\"/\"simulator-w2-b43c84-kserve-self-signed-certs\""
Oct 30 20:38:43.718569 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718547    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.718624 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718586    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.718688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718665    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.718749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718732    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b492l\" (UniqueName: \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.718824 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718805    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.718950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.718909    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.719308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.719291    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:38:43.820485 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820452    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.820686 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820553    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.820686 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820572    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.820686 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820604    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.820864 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820738    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b492l\" (UniqueName: \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.820864 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.820778    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.821103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.821070    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.821175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.821129    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.821175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.821138    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.823061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.823038    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.823204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.823188    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.878690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.878636    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b492l\" (UniqueName: \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\") pod \"simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") " pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:43.925928 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:43.925894    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:44.301656 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:44.301635    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:38:44.304231 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:38:44.304208    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb380dd1e_dd9d_4b76_b2e2_59f758f0cb5b.slice/crio-d265e0b231df944d9ac0698f42d876cb7c6cd48ae26dc1a1309e3d404e88e5f3 WatchSource:0}: Error finding container d265e0b231df944d9ac0698f42d876cb7c6cd48ae26dc1a1309e3d404e88e5f3: Status 404 returned error can't find the container with id d265e0b231df944d9ac0698f42d876cb7c6cd48ae26dc1a1309e3d404e88e5f3
Oct 30 20:38:44.492278 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:44.492230    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" event={"ID":"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b","Type":"ContainerStarted","Data":"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"}
Oct 30 20:38:44.492435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:44.492288    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" event={"ID":"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b","Type":"ContainerStarted","Data":"d265e0b231df944d9ac0698f42d876cb7c6cd48ae26dc1a1309e3d404e88e5f3"}
Oct 30 20:38:44.610854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:44.610813    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podStartSLOduration=1.6107995590000002 podStartE2EDuration="1.610799559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:44.609200075 +0000 UTC m=+690.601203202" watchObservedRunningTime="2026-10-30 20:38:44.610799559 +0000 UTC m=+690.602802716"
Oct 30 20:38:44.926372 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:44.926295    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:49.524975 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:38:49.524909    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:38:52.619142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.619106    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 20:38:52.621876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.621857    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.679233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.679196    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-395022\"/\"kube-root-ca.crt\""
Oct 30 20:38:52.681997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.681972    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 20:38:52.702893 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.702862    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.703055 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.702952    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.703127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.703103    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.703181 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.703164    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.703233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.703218    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wssr\" (UniqueName: \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.703268 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.703253    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.727608 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.727579    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-395022\"/\"simulator-w4-395022-kserve-self-signed-certs\""
Oct 30 20:38:52.727739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.727623    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-395022\"/\"openshift-service-ca.crt\""
Oct 30 20:38:52.727739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.727626    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-395022\"/\"default-dockercfg-gqktn\""
Oct 30 20:38:52.804429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804396    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wssr\" (UniqueName: \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.804429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804438    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.804692 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804506    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.804692 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804587    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.804692 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804654    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.804859 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.804697    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.805099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.805071    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.805290 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.805097    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.805383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.805151    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.806989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.806962    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.807498 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.807476    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.862446 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.862414    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wssr\" (UniqueName: \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\") pod \"simulator-w4-395022-kserve-b6469f6c6-wlgx2\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") " pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:52.934903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:52.934827    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:53.310663 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.310578    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 20:38:53.313735 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:38:53.313711    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbee0c56_d08a_4a39_bc66_d145e59126cf.slice/crio-94c6167938717f17f6f563478f087ce74e6c3d1671d7919e36d1dad37423725e WatchSource:0}: Error finding container 94c6167938717f17f6f563478f087ce74e6c3d1671d7919e36d1dad37423725e: Status 404 returned error can't find the container with id 94c6167938717f17f6f563478f087ce74e6c3d1671d7919e36d1dad37423725e
Oct 30 20:38:53.548637 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.548589    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" event={"ID":"cbee0c56-d08a-4a39-bc66-d145e59126cf","Type":"ContainerStarted","Data":"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"}
Oct 30 20:38:53.548637 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.548642    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" event={"ID":"cbee0c56-d08a-4a39-bc66-d145e59126cf","Type":"ContainerStarted","Data":"94c6167938717f17f6f563478f087ce74e6c3d1671d7919e36d1dad37423725e"}
Oct 30 20:38:53.667942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.667868    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podStartSLOduration=1.6678499279999999 podStartE2EDuration="1.667849928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:53.667485807 +0000 UTC m=+699.659488933" watchObservedRunningTime="2026-10-30 20:38:53.667849928 +0000 UTC m=+699.659853058"
Oct 30 20:38:53.926359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.926273    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:53.935199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.935175    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:38:53.939008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:53.938992    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:38:54.564222 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:38:54.564197    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:39:02.935653 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:02.935620    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:39:02.948158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:02.948133    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:39:03.616465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:03.616436    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:39:19.515018 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:39:19.514983    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:39:24.104574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.104493    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:39:24.109299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.109274    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.172195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.172160    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:39:24.219699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.219657    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"kube-root-ca.crt\""
Oct 30 20:39:24.219865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.219702    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"default-dockercfg-sx62s\""
Oct 30 20:39:24.219865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.219702    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"openshift-service-ca.crt\""
Oct 30 20:39:24.219865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.219776    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"simulator-w1-86d620-kserve-self-signed-certs\""
Oct 30 20:39:24.226256 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226231    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpg5q\" (UniqueName: \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.226370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226342    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.226475 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226446    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.226650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226542    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.226650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226637    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.226776 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.226758    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328511    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpg5q\" (UniqueName: \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328554    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328612    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328641    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328692    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.328990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.328738    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.329055 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.329025    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.329112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.329076    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.329165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.329131    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.331106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.331082    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.331271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.331253    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.390298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.390274    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpg5q\" (UniqueName: \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\") pod \"simulator-w1-86d620-kserve-5d445fcf94-rr4z8\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") " pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.422925 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.422898    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:24.813204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:24.813126    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:39:24.816705 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:39:24.816676    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod576df3c2_c1cd_4e35_9dfd_4797092f2c29.slice/crio-f8e026db0327d7f6baf87a47685c8d650f55c4c614392168dd8589a4b5558cc1 WatchSource:0}: Error finding container f8e026db0327d7f6baf87a47685c8d650f55c4c614392168dd8589a4b5558cc1: Status 404 returned error can't find the container with id f8e026db0327d7f6baf87a47685c8d650f55c4c614392168dd8589a4b5558cc1
Oct 30 20:39:25.716930 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:25.716884    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" event={"ID":"576df3c2-c1cd-4e35-9dfd-4797092f2c29","Type":"ContainerStarted","Data":"3af0c0eac898e5f6ff1de814664b9d8c2d10f29f578d45d71f407089beef2967"}
Oct 30 20:39:25.716930 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:25.716935    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" event={"ID":"576df3c2-c1cd-4e35-9dfd-4797092f2c29","Type":"ContainerStarted","Data":"f8e026db0327d7f6baf87a47685c8d650f55c4c614392168dd8589a4b5558cc1"}
Oct 30 20:39:25.841855 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:25.841811    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podStartSLOduration=1.841798173 podStartE2EDuration="1.841798173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:25.841313101 +0000 UTC m=+731.833316231" watchObservedRunningTime="2026-10-30 20:39:25.841798173 +0000 UTC m=+731.833801299"
Oct 30 20:39:26.423670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:26.423635    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:34.423401 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:34.423369    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:34.435808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:34.435779    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:34.775357 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:34.775271    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:39:49.515767 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:39:49.515733    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:39:58.808095 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.808061    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:39:58.811802 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.811787    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.869842 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.869811    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:39:58.882000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.881976    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.882131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.882008    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.882131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.882030    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.882259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.882172    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c7p9\" (UniqueName: \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.882323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.882256    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.882323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.882275    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.916526 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.916503    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b43c84\"/\"premium-w2-b43c84-kserve-self-signed-certs\""
Oct 30 20:39:58.983182 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983157    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983189    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983208    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983355 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983277    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c7p9\" (UniqueName: \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983363    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983388    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983580    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983669 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983654    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.983728 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.983718    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.985495 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.985476    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:58.985840 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:58.985823    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:59.042517 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:59.042495    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c7p9\" (UniqueName: \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\") pod \"premium-w2-b43c84-kserve-587f4595b-jhdjt\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") " pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:59.124635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:59.124617    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:39:59.514936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:59.514896    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:39:59.517556 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:39:59.517515    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0858ca5e_a17c_4a04_890f_7f2b35dfe52e.slice/crio-2fa46e1aa99f080fe15e7356230c8fccfb0158e363251d27ed5145c8aa13f6f3 WatchSource:0}: Error finding container 2fa46e1aa99f080fe15e7356230c8fccfb0158e363251d27ed5145c8aa13f6f3: Status 404 returned error can't find the container with id 2fa46e1aa99f080fe15e7356230c8fccfb0158e363251d27ed5145c8aa13f6f3
Oct 30 20:39:59.909679 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:59.909645    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" event={"ID":"0858ca5e-a17c-4a04-890f-7f2b35dfe52e","Type":"ContainerStarted","Data":"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"}
Oct 30 20:39:59.910064 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:39:59.909685    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" event={"ID":"0858ca5e-a17c-4a04-890f-7f2b35dfe52e","Type":"ContainerStarted","Data":"2fa46e1aa99f080fe15e7356230c8fccfb0158e363251d27ed5145c8aa13f6f3"}
Oct 30 20:40:00.033448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:40:00.033400    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podStartSLOduration=2.033386233 podStartE2EDuration="2.033386233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:40:00.031675822 +0000 UTC m=+766.023678959" watchObservedRunningTime="2026-10-30 20:40:00.033386233 +0000 UTC m=+766.025389360"
Oct 30 20:40:00.125342 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:40:00.125311    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:40:09.125717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:40:09.125687    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:40:09.138288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:40:09.138263    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:40:09.976472 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:40:09.976432    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:40:19.516439 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:40:19.516404    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:40:49.515701 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:40:49.515665    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:41:09.710905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.710872    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:41:09.714703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.714681    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.824997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.824970    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b32941\"/\"premium-w0-b32941-kserve-self-signed-certs\""
Oct 30 20:41:09.824997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.824977    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b32941\"/\"default-dockercfg-gqqws\""
Oct 30 20:41:09.825198 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.825061    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b32941\"/\"openshift-service-ca.crt\""
Oct 30 20:41:09.825895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.825884    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b32941\"/\"kube-root-ca.crt\""
Oct 30 20:41:09.828010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.827990    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:41:09.829417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829399    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.829463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829444    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.829512 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829504    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.829557 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829544    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.829615 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829576    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5qct\" (UniqueName: \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.829790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.829771    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.930771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.930737    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.930969 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.930789    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.930969 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.930819    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.930969 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.930851    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5qct\" (UniqueName: \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.931153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.931007    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.931153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.931037    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.931295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.931278    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.931366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.931346    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.931409 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.931360    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.933096 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.933072    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.933483 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.933466    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:09.994375 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:09.994342    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5qct\" (UniqueName: \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\") pod \"premium-w0-b32941-kserve-d9995b54f-8hlh4\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") " pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:10.027617 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:10.027593    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:10.429901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:10.428656    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:41:10.432504 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:41:10.432479    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce32708_48b6_43f0_8ced_04043f96cbbf.slice/crio-90b42dab2208dad318ee5e53091708d332377f1647d6f165e304fe2cd842685a WatchSource:0}: Error finding container 90b42dab2208dad318ee5e53091708d332377f1647d6f165e304fe2cd842685a: Status 404 returned error can't find the container with id 90b42dab2208dad318ee5e53091708d332377f1647d6f165e304fe2cd842685a
Oct 30 20:41:10.468804 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:41:10.468779    5446 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce32708_48b6_43f0_8ced_04043f96cbbf.slice/crio-b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 20:41:11.310781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:11.310743    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" event={"ID":"3ce32708-48b6-43f0-8ced-04043f96cbbf","Type":"ContainerStarted","Data":"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"}
Oct 30 20:41:11.310781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:11.310788    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" event={"ID":"3ce32708-48b6-43f0-8ced-04043f96cbbf","Type":"ContainerStarted","Data":"90b42dab2208dad318ee5e53091708d332377f1647d6f165e304fe2cd842685a"}
Oct 30 20:41:11.428615 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:11.428566    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podStartSLOduration=2.428552468 podStartE2EDuration="2.428552468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:41:11.427015016 +0000 UTC m=+837.419018146" watchObservedRunningTime="2026-10-30 20:41:11.428552468 +0000 UTC m=+837.420555595"
Oct 30 20:41:12.028707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:12.028668    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:19.515643 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:41:19.515593    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:41:20.028335 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:20.028308    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:20.040670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:20.040645    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:20.369433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:20.369410    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:41:49.515958 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:41:49.515906    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:41:59.480138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.480106    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:41:59.483768 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.483751    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.517955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.517904    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.517979    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518045    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslh7\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518077    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518095    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518112    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518292 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518220    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518292 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518252    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.518292 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.518273    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.586251 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.586225    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-b32941-openshift-default-dockercfg-rlxkq\""
Oct 30 20:41:59.588610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.588582    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:41:59.619906 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.619882    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.619949    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.619981    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslh7\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620018    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620044    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620072    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620235    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620297    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620325    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620338    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620374    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620514    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.620674 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.620653    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.621075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.621048    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.623009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.622989    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.623105 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.622981    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.677767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.677739    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.677857 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.677810    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslh7\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:41:59.796828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:41:59.796740    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:42:00.226131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.226108    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:42:00.227799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:42:00.227759    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb944a1_df15_40cc_be03_d1dca27f799b.slice/crio-758efb131655d53375f941432cc5e0b5069316555c7e0940d8ad7c6969e635ac WatchSource:0}: Error finding container 758efb131655d53375f941432cc5e0b5069316555c7e0940d8ad7c6969e635ac: Status 404 returned error can't find the container with id 758efb131655d53375f941432cc5e0b5069316555c7e0940d8ad7c6969e635ac
Oct 30 20:42:00.229999 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.229971    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:42:00.230067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.230030    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:42:00.230067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.230059    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:42:00.611886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.611851    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" event={"ID":"2cb944a1-df15-40cc-be03-d1dca27f799b","Type":"ContainerStarted","Data":"8b90e4a2a3c129d16e7eff6be2c18dd1d695aa3fb86bf00da8ef279eb8392682"}
Oct 30 20:42:00.612385 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.611965    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" event={"ID":"2cb944a1-df15-40cc-be03-d1dca27f799b","Type":"ContainerStarted","Data":"758efb131655d53375f941432cc5e0b5069316555c7e0940d8ad7c6969e635ac"}
Oct 30 20:42:00.800085 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:00.800036    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:42:01.815075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:01.815036    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:42:01.815481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:01.815113    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 20:42:02.797247 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:02.797211    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:42:02.797513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:02.797485    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 20:42:03.809316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:03.809282    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:42:03.809899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:03.809869    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 20:42:04.809943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:04.803286    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:42:04.809943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:04.803357    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 20:42:05.804943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:05.798339    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:42:05.804943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:05.798403    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 20:42:06.894100 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:06.894063    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:42:06.894762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:06.894733    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:42:06.895546 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:06.895525    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:42:07.111463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:07.111418    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podStartSLOduration=8.111406287 podStartE2EDuration="8.111406287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:00.827899766 +0000 UTC m=+886.819902892" watchObservedRunningTime="2026-10-30 20:42:07.111406287 +0000 UTC m=+893.103409413"
Oct 30 20:42:19.516165 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:42:19.516126    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:42:49.514770 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:42:49.514688    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:42:59.606683 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.606651    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:42:59.610383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.610368    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.666462 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.666430    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b43c84-openshift-default-dockercfg-xpbj6\""
Oct 30 20:42:59.701463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701435    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701586 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701492    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701586 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701566    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701588    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701616    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701670    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhd4k\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701778    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701811    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.701906 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.701892    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.717054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.717032    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:42:59.802515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802492    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802550    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802581    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802602    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802646    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802873 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802684    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhd4k\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802873 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802723    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.802873 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.802772    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803065 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803007    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803017    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803185    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803413 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803377    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803383    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.803579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.803561    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.805188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.805169    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.805378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.805360    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.860597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.860580    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.860862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.860845    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhd4k\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:42:59.922974 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:42:59.922950    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:43:00.353371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:00.353346    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:43:00.354699 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:43:00.354671    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b778a8_028f_4b00_aba1_50df14c8f738.slice/crio-4d8fa23048dca5299eaf5ba55a2fcf16d9eb7dffcdfa8dd6ac21690a1347a5ac WatchSource:0}: Error finding container 4d8fa23048dca5299eaf5ba55a2fcf16d9eb7dffcdfa8dd6ac21690a1347a5ac: Status 404 returned error can't find the container with id 4d8fa23048dca5299eaf5ba55a2fcf16d9eb7dffcdfa8dd6ac21690a1347a5ac
Oct 30 20:43:00.356905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:00.356878    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:43:00.356995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:00.356957    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:43:00.356995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:00.356987    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:43:01.003941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.002860    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" event={"ID":"d9b778a8-028f-4b00-aba1-50df14c8f738","Type":"ContainerStarted","Data":"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"}
Oct 30 20:43:01.003941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.002944    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" event={"ID":"d9b778a8-028f-4b00-aba1-50df14c8f738","Type":"ContainerStarted","Data":"4d8fa23048dca5299eaf5ba55a2fcf16d9eb7dffcdfa8dd6ac21690a1347a5ac"}
Oct 30 20:43:01.124137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.124084    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podStartSLOduration=2.124070251 podStartE2EDuration="2.124070251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:01.121899878 +0000 UTC m=+947.113903006" watchObservedRunningTime="2026-10-30 20:43:01.124070251 +0000 UTC m=+947.116073377"
Oct 30 20:43:01.924154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.924122    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:43:01.925936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.925897    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 20:43:01.926074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:01.925965    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 20:43:02.923370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:02.923336    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 20:43:02.923750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:02.923390    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 20:43:03.923808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:03.923770    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 20:43:03.924252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:03.923829    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 20:43:04.924086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:04.924044    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 20:43:04.924478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:04.924109    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 20:43:05.923528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:05.923494    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 20:43:05.923706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:05.923548    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 20:43:07.097351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:07.097321    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:43:07.098251 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:07.098225    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:43:07.099240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:07.099220    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:43:19.515356 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:43:19.515318    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:43:26.547805 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.547773    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:43:26.551618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.551602    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.653440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.653409    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:43:26.656143 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.656123    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f6ebf5\"/\"openshift-service-ca.crt\""
Oct 30 20:43:26.656229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.656123    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f6ebf5\"/\"default-dockercfg-ffzrb\""
Oct 30 20:43:26.656229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.656191    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f6ebf5\"/\"kube-root-ca.crt\""
Oct 30 20:43:26.656229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.656206    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f6ebf5\"/\"distinct-w3-f6ebf5-kserve-self-signed-certs\""
Oct 30 20:43:26.686016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.685977    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.686193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.686094    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwz2f\" (UniqueName: \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.686265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.686244    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.686371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.686350    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.686433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.686401    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.686494 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.686462    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787222    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787270    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787331    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787351    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwz2f\" (UniqueName: \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787423    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787502    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787794    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787808    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.787972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.787850    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.789791 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.789772    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.789894 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.789797    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.845963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.845899    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwz2f\" (UniqueName: \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\") pod \"distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") " pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:26.863775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:26.863756    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:27.256778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:27.256755    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:43:27.258829 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:43:27.258795    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod539ff7e3_3945_4bad_a255_f8a287eb6e41.slice/crio-03cd50240690f8efbefcbc1c9b81dc1e4c0e7211a4d1aeb8da8a656e824be63f WatchSource:0}: Error finding container 03cd50240690f8efbefcbc1c9b81dc1e4c0e7211a4d1aeb8da8a656e824be63f: Status 404 returned error can't find the container with id 03cd50240690f8efbefcbc1c9b81dc1e4c0e7211a4d1aeb8da8a656e824be63f
Oct 30 20:43:28.157626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:28.157589    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" event={"ID":"539ff7e3-3945-4bad-a255-f8a287eb6e41","Type":"ContainerStarted","Data":"34123fd878354b764a1cd3aeadacaaaab067f2d22fa3c91a015d3d8a167423d7"}
Oct 30 20:43:28.157626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:28.157627    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" event={"ID":"539ff7e3-3945-4bad-a255-f8a287eb6e41","Type":"ContainerStarted","Data":"03cd50240690f8efbefcbc1c9b81dc1e4c0e7211a4d1aeb8da8a656e824be63f"}
Oct 30 20:43:28.277770 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:28.277711    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podStartSLOduration=2.277698462 podStartE2EDuration="2.277698462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:28.275049571 +0000 UTC m=+974.267052713" watchObservedRunningTime="2026-10-30 20:43:28.277698462 +0000 UTC m=+974.269701589"
Oct 30 20:43:28.864700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:28.864672    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:32.337459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:32.337428    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:43:32.337853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:32.337642    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy" containerID="cri-o://0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f" gracePeriod=30
Oct 30 20:43:36.864492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:36.864447    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:36.877392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:36.877362    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:37.234345 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.234267    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:43:37.624503 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.624475    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:43:37.708220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708190    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708249    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708282    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708373    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708435    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708473    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708489    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:37.708613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708583    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708622    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.708830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708678    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:37.708830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.708712    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\") pod \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\" (UID: \"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15\") "
Oct 30 20:43:37.709176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709130    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:37.709176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709164    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:43:37.709405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709229    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.709405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709252    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.709405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709265    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.709581 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.709444    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:37.711517 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.711486    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:37.711797 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.711770    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "kube-api-access-hmknb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:37.712042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.712008    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:37.712151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.712124    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo" pod "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" (UID: "5b7da9f4-7ad7-4a0a-8940-5d774a3bae15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810794    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810822    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810833    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810843    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810854    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmknb\" (UniqueName: \"kubernetes.io/projected/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-kube-api-access-hmknb\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:37.810875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:37.810863    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:38.217042 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.217009    5446 generic.go:356] "Generic (PLEG): container finished" podID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerID="0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f" exitCode=0
Oct 30 20:43:38.217461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.217064    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"
Oct 30 20:43:38.217461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.217109    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" event={"ID":"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15","Type":"ContainerDied","Data":"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"}
Oct 30 20:43:38.217461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.217173    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk" event={"ID":"5b7da9f4-7ad7-4a0a-8940-5d774a3bae15","Type":"ContainerDied","Data":"c07fc936af4d7aa1a17a7de3f50b9f06d475c070fe2dedea5cd7bdf1b1e1188e"}
Oct 30 20:43:38.217461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.217205    5446 scope.go:122] "RemoveContainer" containerID="0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"
Oct 30 20:43:38.227193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.227173    5446 scope.go:122] "RemoveContainer" containerID="0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"
Oct 30 20:43:38.227490 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:43:38.227469    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f\": container with ID starting with 0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f not found: ID does not exist" containerID="0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"
Oct 30 20:43:38.227570 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.227500    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f"} err="failed to get container status \"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f\": rpc error: code = NotFound desc = could not find container \"0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f\": container with ID starting with 0b4804224c17c353c73475099e70fc11c61fb70b83d906ac6b7d43342be92d7f not found: ID does not exist"
Oct 30 20:43:38.384102 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.384020    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:43:38.389031 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:38.389006    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-rsxpk"]
Oct 30 20:43:40.120563 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.120520    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" path="/var/lib/kubelet/pods/5b7da9f4-7ad7-4a0a-8940-5d774a3bae15/volumes"
Oct 30 20:43:40.809346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.809313    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 20:43:40.809810 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.809798    5446 cpu_manager.go:414] "containerMap: removing container" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy"
Oct 30 20:43:40.809850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.809812    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy"
Oct 30 20:43:40.809898 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.809890    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b7da9f4-7ad7-4a0a-8940-5d774a3bae15" containerName="istio-proxy"
Oct 30 20:43:40.814315 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.814298    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.887973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.887945    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 20:43:40.918275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.918253    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-ee3fad\"/\"openshift-service-ca.crt\""
Oct 30 20:43:40.918412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.918289    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-ee3fad\"/\"default-dockercfg-gjcdt\""
Oct 30 20:43:40.918547 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.918532    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-ee3fad\"/\"kube-root-ca.crt\""
Oct 30 20:43:40.918606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.918579    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-ee3fad\"/\"distinct-w6-ee3fad-kserve-self-signed-certs\""
Oct 30 20:43:40.945741 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.945716    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.945854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.945773    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.945854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.945840    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.946097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.945869    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4twk\" (UniqueName: \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.946097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.945911    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:40.946097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:40.946028    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.046887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.046854    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.046940    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.046960    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.046979    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4twk\" (UniqueName: \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.047013    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047112 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.047051    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.047361    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.047384    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.047459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.047424    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.049463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.049438    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.049652 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.049635    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.104946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.104868    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4twk\" (UniqueName: \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\") pod \"distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") " pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.126081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.126058    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:41.508931 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:41.508897    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 20:43:41.511204 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:43:41.511173    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca38e01b_8054_465e_9074_70ed93f8dfc3.slice/crio-e3672ad16b3f2f6d5d01fa6afea1121c5639637a4d24fcee1731ea3fc2f24a77 WatchSource:0}: Error finding container e3672ad16b3f2f6d5d01fa6afea1121c5639637a4d24fcee1731ea3fc2f24a77: Status 404 returned error can't find the container with id e3672ad16b3f2f6d5d01fa6afea1121c5639637a4d24fcee1731ea3fc2f24a77
Oct 30 20:43:42.244694 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:42.244661    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" event={"ID":"ca38e01b-8054-465e-9074-70ed93f8dfc3","Type":"ContainerStarted","Data":"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"}
Oct 30 20:43:42.245114 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:42.244701    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" event={"ID":"ca38e01b-8054-465e-9074-70ed93f8dfc3","Type":"ContainerStarted","Data":"e3672ad16b3f2f6d5d01fa6afea1121c5639637a4d24fcee1731ea3fc2f24a77"}
Oct 30 20:43:42.381519 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:42.381475    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podStartSLOduration=2.381459899 podStartE2EDuration="2.381459899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:42.379282397 +0000 UTC m=+988.371285524" watchObservedRunningTime="2026-10-30 20:43:42.381459899 +0000 UTC m=+988.373463030"
Oct 30 20:43:43.126928 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:43.126886    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:49.521292 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:43:49.521252    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:43:51.130942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.130166    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:51.170237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.170208    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:51.312151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.312124    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:43:51.338938 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.338271    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:43:51.343231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.343111    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.400070 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.399849    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"distinct-w1-86d620-kserve-self-signed-certs\""
Oct 30 20:43:51.403231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.403203    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:43:51.463174 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463132    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.463385 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463358    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.463468 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463438    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.463526 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463514    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.463623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463601    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sj8d\" (UniqueName: \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.463681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.463658    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564353    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564550 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564432    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564568    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564680 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564626    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564680 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564666    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564690    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sj8d\" (UniqueName: \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.564888 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564864    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.565010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.564991    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.565218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.565148    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.566851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.566830    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.566976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.566898    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.622681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.622658    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sj8d\" (UniqueName: \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\") pod \"distinct-w1-86d620-kserve-6c7ff98ff8-b7chk\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:51.659477 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:51.659423    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:43:52.060116 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:52.060088    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:43:52.062754 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:43:52.062725    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06558642_9198_456e_86cc_b4644dc8da26.slice/crio-bd00ff8f6bf799a9a9ffe944eba9c15d6fd3c26d412211c3570b27cbfc0f0244 WatchSource:0}: Error finding container bd00ff8f6bf799a9a9ffe944eba9c15d6fd3c26d412211c3570b27cbfc0f0244: Status 404 returned error can't find the container with id bd00ff8f6bf799a9a9ffe944eba9c15d6fd3c26d412211c3570b27cbfc0f0244
Oct 30 20:43:52.305597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:52.305517    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" event={"ID":"06558642-9198-456e-86cc-b4644dc8da26","Type":"ContainerStarted","Data":"14b112369cc1da087d02548b9c547b4cd02464c788ce6b693fa20a436463be86"}
Oct 30 20:43:52.305597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:52.305560    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" event={"ID":"06558642-9198-456e-86cc-b4644dc8da26","Type":"ContainerStarted","Data":"bd00ff8f6bf799a9a9ffe944eba9c15d6fd3c26d412211c3570b27cbfc0f0244"}
Oct 30 20:43:52.424816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:52.424761    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podStartSLOduration=1.424744372 podStartE2EDuration="1.424744372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:52.424032643 +0000 UTC m=+998.416035770" watchObservedRunningTime="2026-10-30 20:43:52.424744372 +0000 UTC m=+998.416747499"
Oct 30 20:43:52.659814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:43:52.659786    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:44:01.659872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:01.659836    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:44:01.672418 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:01.672393    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:44:02.376339 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:02.376311    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:44:18.092420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.092390    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:44:18.097819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.097797    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.153158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.153130    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:44:18.171229 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171194    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw5gh\" (UniqueName: \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.171384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171261    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.171552 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171533    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.171701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171679    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.171856 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171834    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.172006 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.171894    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.199350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.199331    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b32941\"/\"distinct-2-w0-b32941-kserve-self-signed-certs\""
Oct 30 20:44:18.273248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.273209    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5gh\" (UniqueName: \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.273517 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.273500    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.274103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.274083    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.274582 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.274566    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.275118 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.275101    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.275819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.275790    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.275946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.274449    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.275946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.275729    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.275946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.273996    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.281220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.281191    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.283477 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.283453    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.332982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.332959    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw5gh\" (UniqueName: \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\") pod \"distinct-2-w0-b32941-kserve-55858b66bc-57mcn\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") " pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.410099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.410075    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:18.784704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:18.784679    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:44:18.786510 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:44:18.786484    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87c7712e_566e_4544_b28d_1d261560561a.slice/crio-79870b57f22492014f9a1f8521c465fce16611678430906c136886be126debd1 WatchSource:0}: Error finding container 79870b57f22492014f9a1f8521c465fce16611678430906c136886be126debd1: Status 404 returned error can't find the container with id 79870b57f22492014f9a1f8521c465fce16611678430906c136886be126debd1
Oct 30 20:44:19.476516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:19.476482    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" event={"ID":"87c7712e-566e-4544-b28d-1d261560561a","Type":"ContainerStarted","Data":"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"}
Oct 30 20:44:19.477024 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:19.476523    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" event={"ID":"87c7712e-566e-4544-b28d-1d261560561a","Type":"ContainerStarted","Data":"79870b57f22492014f9a1f8521c465fce16611678430906c136886be126debd1"}
Oct 30 20:44:19.515809 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:44:19.515776    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:44:19.593740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:19.593690    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podStartSLOduration=1.593676705 podStartE2EDuration="1.593676705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:19.591398413 +0000 UTC m=+1025.583401551" watchObservedRunningTime="2026-10-30 20:44:19.593676705 +0000 UTC m=+1025.585679872"
Oct 30 20:44:20.410805 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:20.410776    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:28.410249 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:28.410212    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:28.422361 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:28.422339    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:28.534901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:28.534873    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:44:29.599781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.599752    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:44:29.603330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.603314    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693334 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693303    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693498 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693452    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693540    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693666 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693647    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693736 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693710    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693787    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693857    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9rn\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.693947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693891    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.694014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.693956    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.707131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.707104    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:44:29.794726 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794701    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.794880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794756    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.794880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794789    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.794880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794808    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.794880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794835    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9rn\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.794992    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795040    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795137    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795212    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795227    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795397 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795293    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795620    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795725 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795705    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.795858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.795841    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.797126 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.797107    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.797380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.797360    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.852699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.852643    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.853070 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.853054    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9rn\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-6krrw\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.916874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.916852    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:29.917731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.917713    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:44:29.921387 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.921370    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.984704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.984648    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:44:29.997541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997517    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997550    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997573    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb58g\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997642    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997709    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997740    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997786    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.997929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997863    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:29.998106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:29.997996    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.098966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.098938    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.098972    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.098994    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb58g\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099013    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099033    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099047    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099090    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099125    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099162    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099372    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099435    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099627 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099576    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.099667 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.099631    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.100023 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.100003    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.101496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.101479    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.101551 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.101534    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.158396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.158368    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.158570 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.158553    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb58g\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.247098 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.247079    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:30.348162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.348132    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:44:30.349930 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:44:30.349881    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f9832f_07dc_4ffd_af6c_937b169f2568.slice/crio-8073a0bacae93ce78f80394f3f67f33f7041406e22c89bceb985a5a77daabf34 WatchSource:0}: Error finding container 8073a0bacae93ce78f80394f3f67f33f7041406e22c89bceb985a5a77daabf34: Status 404 returned error can't find the container with id 8073a0bacae93ce78f80394f3f67f33f7041406e22c89bceb985a5a77daabf34
Oct 30 20:44:30.352575 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.352542    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.352681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.352620    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.352681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.352667    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.538571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.538534    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" event={"ID":"39f9832f-07dc-4ffd-af6c-937b169f2568","Type":"ContainerStarted","Data":"9bcf13c6f473cb5fa87d7197ebec3c5e7588276cf51a8bd215bfa591f1d5412e"}
Oct 30 20:44:30.538738 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.538597    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" event={"ID":"39f9832f-07dc-4ffd-af6c-937b169f2568","Type":"ContainerStarted","Data":"8073a0bacae93ce78f80394f3f67f33f7041406e22c89bceb985a5a77daabf34"}
Oct 30 20:44:30.624798 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.624740    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:44:30.627553 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:44:30.627527    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c46c14_c659_4868_93a7_8aedb25985ce.slice/crio-4b3c30fb44351b9fbab6bcc8bc3a073ec7e87f6ec74e8dfc81b0e18e98d4185c WatchSource:0}: Error finding container 4b3c30fb44351b9fbab6bcc8bc3a073ec7e87f6ec74e8dfc81b0e18e98d4185c: Status 404 returned error can't find the container with id 4b3c30fb44351b9fbab6bcc8bc3a073ec7e87f6ec74e8dfc81b0e18e98d4185c
Oct 30 20:44:30.630021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.629992    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.630134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.630047    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.630134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.630074    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:44:30.657025 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.656977    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podStartSLOduration=1.656963704 podStartE2EDuration="1.656963704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:30.655087541 +0000 UTC m=+1036.647090672" watchObservedRunningTime="2026-10-30 20:44:30.656963704 +0000 UTC m=+1036.648966887"
Oct 30 20:44:30.917773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:30.917697    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:31.564934 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:31.564890    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" event={"ID":"29c46c14-c659-4868-93a7-8aedb25985ce","Type":"ContainerStarted","Data":"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"}
Oct 30 20:44:31.565137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:31.564972    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" event={"ID":"29c46c14-c659-4868-93a7-8aedb25985ce","Type":"ContainerStarted","Data":"4b3c30fb44351b9fbab6bcc8bc3a073ec7e87f6ec74e8dfc81b0e18e98d4185c"}
Oct 30 20:44:31.687786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:31.687729    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podStartSLOduration=2.687714441 podStartE2EDuration="2.687714441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:31.685279554 +0000 UTC m=+1037.677282681" watchObservedRunningTime="2026-10-30 20:44:31.687714441 +0000 UTC m=+1037.679717567"
Oct 30 20:44:31.939383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:31.938158    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:31.939383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:31.938230    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:32.248387 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:32.248304    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:32.249629 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:32.249610    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:32.249703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:32.249654    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:32.920347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:32.920308    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:32.921107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:32.921077    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:33.248101 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:33.248015    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:33.248101 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:33.248071    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:33.925340 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:33.925301    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:33.925949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:33.925892    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:34.249745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:34.249256    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:34.249745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:34.249316    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:34.917941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:34.917295    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:34.917941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:34.917355    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:35.247465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:35.247376    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:35.247465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:35.247429    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:35.925942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:35.923309    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:35.925942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:35.923371    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:36.248023 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:36.247774    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:36.248023 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:36.247830    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:36.917549 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:36.917513    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 20:44:36.917725 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:36.917576    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 20:44:37.248327 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:37.248096    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:44:37.248327 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:37.248164    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 20:44:37.921436 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:37.921404    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:37.921799 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:37.921778    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:37.922405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:37.922388    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:44:38.252569 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:38.252484    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:38.253060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:38.252764    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:38.253468 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:44:38.253442    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:44:49.514721 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:44:49.514684    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:45:00.996874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:00.996842    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:45:01.000827 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.000808    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010419 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010396    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010427    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010460    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010638    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010719    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010752    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010807 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010784    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm6sl\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.010964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.010948    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.011016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.011005    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.060442 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.060409    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:45:01.112335 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112297    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112344    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112371    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112437    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112496    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112523    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112553    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm6sl\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.112723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112694    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113006 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112942    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113006 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.112963    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113160 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.113054    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.113305    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.113319    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.113431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.113383    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.115855 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.115829    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.116230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.116214    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.171005 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.170973    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm6sl\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.171403 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.171384    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.314508 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.314423    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:01.743346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.743312    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:45:01.783802 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:45:01.783774    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d023d8_fc01_4c15_9e22_c39592c46938.slice/crio-d6f616a12f7e1c531c8a16db0ef7be1f6c34da3b3efe9fd6f86fafa87ce8aba8 WatchSource:0}: Error finding container d6f616a12f7e1c531c8a16db0ef7be1f6c34da3b3efe9fd6f86fafa87ce8aba8: Status 404 returned error can't find the container with id d6f616a12f7e1c531c8a16db0ef7be1f6c34da3b3efe9fd6f86fafa87ce8aba8
Oct 30 20:45:01.786186 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.786155    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:01.786269 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.786220    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:01.786269 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:01.786249    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:02.775937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:02.775884    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" event={"ID":"a6d023d8-fc01-4c15-9e22-c39592c46938","Type":"ContainerStarted","Data":"a7ac833b0021522a888db2b58a481d6a743c6d906c2d8b6d299c442fc0528477"}
Oct 30 20:45:02.776386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:02.775975    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" event={"ID":"a6d023d8-fc01-4c15-9e22-c39592c46938","Type":"ContainerStarted","Data":"d6f616a12f7e1c531c8a16db0ef7be1f6c34da3b3efe9fd6f86fafa87ce8aba8"}
Oct 30 20:45:02.945469 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:02.945415    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podStartSLOduration=2.945400093 podStartE2EDuration="2.945400093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:02.942610262 +0000 UTC m=+1068.934613392" watchObservedRunningTime="2026-10-30 20:45:02.945400093 +0000 UTC m=+1068.937403220"
Oct 30 20:45:03.314659 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:03.314626    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:03.316604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:03.316578    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:03.316742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:03.316633    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:04.315184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:04.315150    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:04.315701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:04.315212    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:05.315610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:05.315575    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:05.316151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:05.315639    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:06.315431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:06.315398    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:06.315661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:06.315471    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:07.315507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:07.315469    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:07.315700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:07.315535    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:08.315201 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:08.315169    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:45:08.315376 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:08.315246    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 20:45:09.319660 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:09.319632    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:09.320074 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:09.320007    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:09.320684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:09.320664    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:45:19.517230 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:45:19.517195    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:45:45.899743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:45.899667    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:45:45.903748 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:45.903732    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.008631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.008606    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:45:46.026571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026540    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026655    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026689    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026750    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x2j\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026773    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026799    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.026984 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.026959    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.027044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.027011    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.027116 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.027099    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128533    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128580    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128625    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128720    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128797    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128845    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.128874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128865    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x2j\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129004 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128888    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129004 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.128983    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129194 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.129162    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.129273    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.129301    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.129332    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.129498 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.129477    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.131316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.131294    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.131420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.131393    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.187231 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.187171    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.187317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.187227    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x2j\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.215933 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.215901    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:46.652014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.651987    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:45:46.654264 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:45:46.654240    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ca5fe9_2837_4113_967f_bbdab03c259b.slice/crio-f4c04082874b4b80098601f12dfcd1ccbb7b720dd418922f067db24991de5317 WatchSource:0}: Error finding container f4c04082874b4b80098601f12dfcd1ccbb7b720dd418922f067db24991de5317: Status 404 returned error can't find the container with id f4c04082874b4b80098601f12dfcd1ccbb7b720dd418922f067db24991de5317
Oct 30 20:45:46.656511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.656481    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:46.656569 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.656542    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:46.656613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.656569    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:45:46.743233 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.743206    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:45:46.747140 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.747124    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.803793 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.803608    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-86d620\"/\"distinct-2-w1-86d620-kserve-self-signed-certs\""
Oct 30 20:45:46.807113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.807086    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:45:46.837782 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.837741    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.837993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.837947    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.837993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.837986    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.838143 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.838066    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.838209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.838194    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.838585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.838279    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.939631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939491    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.939631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939604    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939633    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939692    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939735    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939840    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.939945    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.940232    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.940481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.940247    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.942298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.942277    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.942972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.942908    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:46.998135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:46.998111    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\") pod \"distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") " pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:47.060481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.060449    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:47.070220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.070181    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" event={"ID":"f9ca5fe9-2837-4113-967f-bbdab03c259b","Type":"ContainerStarted","Data":"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"}
Oct 30 20:45:47.070349 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.070240    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" event={"ID":"f9ca5fe9-2837-4113-967f-bbdab03c259b","Type":"ContainerStarted","Data":"f4c04082874b4b80098601f12dfcd1ccbb7b720dd418922f067db24991de5317"}
Oct 30 20:45:47.204505 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.204416    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podStartSLOduration=2.204400397 podStartE2EDuration="2.204400397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:47.203333265 +0000 UTC m=+1113.195336405" watchObservedRunningTime="2026-10-30 20:45:47.204400397 +0000 UTC m=+1113.196403523"
Oct 30 20:45:47.220342 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.219365    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:47.220527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.220370    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:47.220527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.220451    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:47.466681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:47.466412    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:45:47.469375 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:45:47.469349    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ec952f_084e_4eb6_9a16_b00c4aef19d3.slice/crio-32ce01bca7e03a051d90fe814a88e2eb4772e5373a4ff18dfc4b65156f94afcc WatchSource:0}: Error finding container 32ce01bca7e03a051d90fe814a88e2eb4772e5373a4ff18dfc4b65156f94afcc: Status 404 returned error can't find the container with id 32ce01bca7e03a051d90fe814a88e2eb4772e5373a4ff18dfc4b65156f94afcc
Oct 30 20:45:48.078544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:48.077988    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" event={"ID":"b2ec952f-084e-4eb6-9a16-b00c4aef19d3","Type":"ContainerStarted","Data":"62cb6c5495ca93fdfa24dca95eda141ebeecac1acf9a7cc27db2fd3f863f9f00"}
Oct 30 20:45:48.078544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:48.078064    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" event={"ID":"b2ec952f-084e-4eb6-9a16-b00c4aef19d3","Type":"ContainerStarted","Data":"32ce01bca7e03a051d90fe814a88e2eb4772e5373a4ff18dfc4b65156f94afcc"}
Oct 30 20:45:48.217076 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:48.217032    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:48.217273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:48.217083    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:49.060613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:49.060579    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:49.216398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:49.216363    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:49.217027 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:49.216421    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:49.538506 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:45:49.538471    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:45:50.216359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:50.216319    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:50.216523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:50.216384    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:51.233947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:51.232982    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:51.233947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:51.233047    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:52.219306 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:52.219265    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:52.219627 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:52.219319    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:53.216300 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:53.216268    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:45:53.216844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:53.216321    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 20:45:54.221271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:54.221240    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:54.221749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:54.221539    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:54.223022 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:54.222995    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:45:54.392890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:54.392844    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podStartSLOduration=8.392831636 podStartE2EDuration="8.392831636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:48.215389596 +0000 UTC m=+1114.207392724" watchObservedRunningTime="2026-10-30 20:45:54.392831636 +0000 UTC m=+1120.384834763"
Oct 30 20:45:57.060771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:57.060739    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:57.073538 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:57.073515    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:45:57.183139 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:45:57.183115    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:46:16.581765 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.581731    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:46:16.585895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.585875    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.692270 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.692238    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:46:16.693499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693477    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693556 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693522    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693581    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693659    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693736 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693719    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693874 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693857    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.693966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.693950    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trpz2\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.694017 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.694005    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.694153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.694138    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795249    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795282    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795302    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795327    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795363    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795440    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795493    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trpz2\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795539    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795634    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.795783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.795705    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.796175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.796063    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.796319 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.796174    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.796319 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.796249    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.796433 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.796424    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.797905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.797884    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.798150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.798131    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.854010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.853905    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.854240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.854223    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trpz2\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\") pod \"e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") " pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:16.899126 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:16.899106    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:17.329979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:17.329957    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:46:17.331593 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:46:17.331568    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2af59a_80c9_42a9_a9af_d972710280d8.slice/crio-66be10b2ca8620d7bbd677bfce2eedb56cbb9cbe455c7f712924d4d77ebfec58 WatchSource:0}: Error finding container 66be10b2ca8620d7bbd677bfce2eedb56cbb9cbe455c7f712924d4d77ebfec58: Status 404 returned error can't find the container with id 66be10b2ca8620d7bbd677bfce2eedb56cbb9cbe455c7f712924d4d77ebfec58
Oct 30 20:46:17.333885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:17.333857    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:17.333960 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:17.333943    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:17.333999 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:17.333976    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:18.323161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.323118    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" event={"ID":"2a2af59a-80c9-42a9-a9af-d972710280d8","Type":"ContainerStarted","Data":"8a9182cd5926bc943ba4f00227947d1ecc850d16d2aa2d3329f8883c5370671b"}
Oct 30 20:46:18.323664 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.323177    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" event={"ID":"2a2af59a-80c9-42a9-a9af-d972710280d8","Type":"ContainerStarted","Data":"66be10b2ca8620d7bbd677bfce2eedb56cbb9cbe455c7f712924d4d77ebfec58"}
Oct 30 20:46:18.565763 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.565709    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podStartSLOduration=2.565695647 podStartE2EDuration="2.565695647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:18.514523225 +0000 UTC m=+1144.506526353" watchObservedRunningTime="2026-10-30 20:46:18.565695647 +0000 UTC m=+1144.557698858"
Oct 30 20:46:18.901271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.901237    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:18.913083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.913048    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:18.913218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:18.913102    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:19.538847 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:46:19.538812    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:46:19.905952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:19.902241    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:19.905952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:19.902301    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:20.908321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:20.908286    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:20.908939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:20.908882    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:21.905261 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:21.905225    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:21.905447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:21.905299    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:22.901264 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:22.901230    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:22.901851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:22.901823    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:23.900408 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:23.900374    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 20:46:23.900658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:23.900423    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 20:46:24.904279 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:24.904251    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:24.904726 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:24.904716    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:24.905420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:24.905402    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:46:29.553417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.553380    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:46:29.557826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.557808    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658605    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658639    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658666    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658784    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658869 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658829    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.658869 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658846    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp8nm\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.659004 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.658987    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.659041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.659033    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.659076 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.659067    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.709838 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.709812    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:46:29.759828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.759803    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.759973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.759855    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.759973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.759890    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.759973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.759961    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760105 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.759978    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760105 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760005    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760105 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760074    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760129    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760153    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp8nm\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760248    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760419 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760275    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760419 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760349    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760683    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.760774 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.760728    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.762496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.762472    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.762666 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.762651    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.832796 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.832735    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.834079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.834062    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp8nm\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.834786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.834769    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:46:29.839781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.839765    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.874125 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.874100    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:29.894777 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.894752    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-386743\"/\"openshift-service-ca.crt\""
Oct 30 20:46:29.895420 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.895398    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-386743\"/\"kube-root-ca.crt\""
Oct 30 20:46:29.896255 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.896232    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-386743\"/\"distinct-2-w5-386743-kserve-self-signed-certs\""
Oct 30 20:46:29.896365 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.896319    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-386743\"/\"default-dockercfg-7mljt\""
Oct 30 20:46:29.899820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.899794    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:46:29.963280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963200    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.963479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963459    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4ks\" (UniqueName: \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.963565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963498    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.963565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963531    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.963682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963562    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:29.963682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:29.963614    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066003    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4ks\" (UniqueName: \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066044    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066068    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066087    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066241    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066404    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066494    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066667    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.066811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.066754    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.068532 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.068511    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.068673 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.068657    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.128619 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.128596    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4ks\" (UniqueName: \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\") pod \"distinct-2-w5-386743-kserve-7fdc8bf846-njbqf\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") " pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.167399 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.167366    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:30.312090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.312064    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:46:30.314320 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:46:30.314288    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c6e90c_c3d8_4862_bbd9_84c4bf782946.slice/crio-1186d9d2b723dcfef25da1659056d64415da1ea8e355bff34d4afd1fdc3b9a19 WatchSource:0}: Error finding container 1186d9d2b723dcfef25da1659056d64415da1ea8e355bff34d4afd1fdc3b9a19: Status 404 returned error can't find the container with id 1186d9d2b723dcfef25da1659056d64415da1ea8e355bff34d4afd1fdc3b9a19
Oct 30 20:46:30.316974 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.316907    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:30.317079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.317021    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:30.317079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.317066    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:46:30.397272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.397217    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" event={"ID":"98c6e90c-c3d8-4862-bbd9-84c4bf782946","Type":"ContainerStarted","Data":"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"}
Oct 30 20:46:30.397272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.397272    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" event={"ID":"98c6e90c-c3d8-4862-bbd9-84c4bf782946","Type":"ContainerStarted","Data":"1186d9d2b723dcfef25da1659056d64415da1ea8e355bff34d4afd1fdc3b9a19"}
Oct 30 20:46:30.517484 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.517431    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podStartSLOduration=1.5174173020000001 podStartE2EDuration="1.517417302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:30.515123749 +0000 UTC m=+1156.507126878" watchObservedRunningTime="2026-10-30 20:46:30.517417302 +0000 UTC m=+1156.509420502"
Oct 30 20:46:30.581525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.581499    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:46:30.582682 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:46:30.582653    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca50717d_68ff_4b38_8cc7_411c6ed4843f.slice/crio-d5d4d9a0febcc5ed90cb2b05a0ea9bfc6de984bf2b5c05066ca3f561106a893b WatchSource:0}: Error finding container d5d4d9a0febcc5ed90cb2b05a0ea9bfc6de984bf2b5c05066ca3f561106a893b: Status 404 returned error can't find the container with id d5d4d9a0febcc5ed90cb2b05a0ea9bfc6de984bf2b5c05066ca3f561106a893b
Oct 30 20:46:30.875151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:30.875128    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:31.418803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:31.418771    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" event={"ID":"ca50717d-68ff-4b38-8cc7-411c6ed4843f","Type":"ContainerStarted","Data":"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"}
Oct 30 20:46:31.418803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:31.418815    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" event={"ID":"ca50717d-68ff-4b38-8cc7-411c6ed4843f","Type":"ContainerStarted","Data":"d5d4d9a0febcc5ed90cb2b05a0ea9bfc6de984bf2b5c05066ca3f561106a893b"}
Oct 30 20:46:31.538201 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:31.538148    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podStartSLOduration=2.538132163 podStartE2EDuration="2.538132163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:31.535014934 +0000 UTC m=+1157.527018061" watchObservedRunningTime="2026-10-30 20:46:31.538132163 +0000 UTC m=+1157.530135290"
Oct 30 20:46:31.881141 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:31.879013    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:31.881141 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:31.879070    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:32.169991 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:32.168199    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:32.876965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:32.874544    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:32.876965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:32.874617    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:33.554943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:33.554124    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:46:33.614297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:33.613132    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:46:33.879628 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:33.879597    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:33.879948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:33.879889    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:33.972839 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:33.972004    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:46:34.118944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:34.115071    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:46:34.219181 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:34.219080    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": context deadline exceeded"
Oct 30 20:46:34.360655 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:34.360175    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:46:34.875462 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:34.875427    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:34.875854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:34.875491    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:35.874811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:35.874776    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:35.875003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:35.874826    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:36.875944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:36.875886    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 20:46:36.876404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:36.875953    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 20:46:38.037422 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:38.037387    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:38.037878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:38.037856    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:38.038733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:38.038706    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:46:40.167757 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:40.167723    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:40.181026 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:40.181002    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:40.518135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:46:40.518062    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:46:49.515839 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:46:49.515800    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:47:00.796380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.796351    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:47:00.800238 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.800220    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934089    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rql\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934160    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934249    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934338 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934288    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934383    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934449    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934549 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934537    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934559    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:00.934618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:00.934586    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.007618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.007590    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:47:01.036228 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036194    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036239    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036268    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036313    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rql\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036584 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036408    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036584 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036464    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036584 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036509    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036581    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036601    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036742 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036680    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.036904 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.036877    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.037078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.037057    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.037283 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.037257    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.037562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.037539    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.039515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.039493    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.039618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.039597    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.094491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.094416    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.094770 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.094750    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rql\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\") pod \"e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") " pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.113992 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.113972    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:01.547342 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.547319    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:47:01.548941 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:47:01.548891    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eaa394_a7cc_47bb_9165_d1f695059dec.slice/crio-3d48df71f4cdc8c151e6de8641764223321090bae91fcd66d31a4886d70fa860 WatchSource:0}: Error finding container 3d48df71f4cdc8c151e6de8641764223321090bae91fcd66d31a4886d70fa860: Status 404 returned error can't find the container with id 3d48df71f4cdc8c151e6de8641764223321090bae91fcd66d31a4886d70fa860
Oct 30 20:47:01.551308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.551278    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:01.551376 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.551338    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:01.551376 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.551365    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:01.636441 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.636405    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" event={"ID":"c6eaa394-a7cc-47bb-9165-d1f695059dec","Type":"ContainerStarted","Data":"2308ffdc6f76336ce2c38f6ab119834f7b8fb5dd2405b08a8dac749cec554840"}
Oct 30 20:47:01.636566 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.636472    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" event={"ID":"c6eaa394-a7cc-47bb-9165-d1f695059dec","Type":"ContainerStarted","Data":"3d48df71f4cdc8c151e6de8641764223321090bae91fcd66d31a4886d70fa860"}
Oct 30 20:47:01.758595 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:01.758542    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podStartSLOduration=1.758526631 podStartE2EDuration="1.758526631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:01.756457744 +0000 UTC m=+1187.748460871" watchObservedRunningTime="2026-10-30 20:47:01.758526631 +0000 UTC m=+1187.750529758"
Oct 30 20:47:02.116135 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:02.116104    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:02.116495 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:02.116164    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:02.121089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:02.121064    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:03.114291 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:03.114262    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:03.114486 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:03.114308    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:04.116311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:04.116270    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:04.116979 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:04.116897    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:05.122943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.119188    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:05.122943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.119257    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:05.367939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.367862    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:05.560108 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.560004    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:05.775945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.774002    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:05.971057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:05.971008    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:06.122606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.122562    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.136942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.131458    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:06.136942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.131510    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:06.187956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.176409    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.215940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.215017    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:06.317818 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.317718    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.373225 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.371016    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:06.373225 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.371453    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:47:06.374373 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.374340    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:06.708945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.684001    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.749702 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.709261    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.750196 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.728290    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.771942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.728322    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 20:47:06.771942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.766497    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:47:06.787041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.786996    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:06.796128 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.796091    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:47:06.984100 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.983996    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.015990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:06.996329    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:47:07.089445 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.089414    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:47:07.131899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.131861    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:47:07.133517 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.133493    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:47:07.158580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.158551    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:07.159145 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.159112    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:07.206030 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.204516    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.209958 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.206309    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:47:07.236307 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.235146    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.237427 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.236585    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:47:07.364895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.364001    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:47:07.369973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.366961    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:47:07.409349 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.373977    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.468169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.468116    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.468690 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.468670    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:47:07.569102 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.569019    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:47:07.604467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.604436    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:47:07.774395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.774365    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:47:07.791745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.791685    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:47:07.793326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.793288    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:47:07.815260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.814643    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:07.871163 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:07.871132    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:08.014371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.014343    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:47:08.103944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.082996    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:47:08.103944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.092374    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:47:08.103944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.099592    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:47:08.123999 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.118532    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:08.127713 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.127659    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:47:08.128604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.128576    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:08.128762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.128623    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:08.129948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:08.129907    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:47:09.120641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:09.119298    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:09.120641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:09.119352    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:10.116023 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:10.115909    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:47:10.116023 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:10.115990    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 20:47:11.119254 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:11.119224    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:11.119716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:11.119688    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:11.120363 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:11.120345    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:47:19.516046 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:47:19.516006    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:47:31.360861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.360827    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:47:31.364870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.364855    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.471565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.471535    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:47:31.501558 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501526    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501581    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501703    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501766    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501858    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501910 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501896    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.501997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.501982    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.502046 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.502005    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7cb\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.502046 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.502036    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603237    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603293    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603326    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603349    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603369    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603384    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7cb\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603414    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603541    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603585    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603807 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603678    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603807 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603683    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603902 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603802    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.603902 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.603880    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.604223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.604204    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.606070 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.606046    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.606478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.606342    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.664116 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.664070    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7cb\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.666695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.666675    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\") pod \"e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") " pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.677891 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.677874    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:31.813471 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.813439    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:47:31.817620 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.817605    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.883637 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.883594    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:47:31.907346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907321    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907356    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907436    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907608 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907591    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907679 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907617    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907679 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907642    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907784 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907680    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907784 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907709    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp8zk\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:31.907784 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:31.907740    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.008664 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008582    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.008664 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008617    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.008664 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008635    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.008664 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008660    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008779    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp8zk\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008823    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.008979    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009007    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009040    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009151    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009361    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009450    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009484    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.009762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.009741    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.011151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.011129    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.011450 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.011434    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.070373 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.070350    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.070566 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.070549    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp8zk\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\") pod \"e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") " pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.112058 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.111767    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:47:32.114263 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:47:32.114241    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67338f1c_e52a_40ed_a431_06614b480d8a.slice/crio-7b7a0d2ad7218d246969e02e5337a19761f015862ac773148320560bbff1f6a9 WatchSource:0}: Error finding container 7b7a0d2ad7218d246969e02e5337a19761f015862ac773148320560bbff1f6a9: Status 404 returned error can't find the container with id 7b7a0d2ad7218d246969e02e5337a19761f015862ac773148320560bbff1f6a9
Oct 30 20:47:32.116576 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.116550    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:32.116672 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.116609    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:32.116672 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.116638    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:32.131630 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.131593    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:32.573177 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.573151    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:47:32.574873 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:47:32.574844    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892fb78f_70d5_4b96_bb8e_101009d50b9b.slice/crio-c04e047cf5b60b1f086c10dfe42c4fd11602d1c1b8d89ee3ecdbddcb0a307fcb WatchSource:0}: Error finding container c04e047cf5b60b1f086c10dfe42c4fd11602d1c1b8d89ee3ecdbddcb0a307fcb: Status 404 returned error can't find the container with id c04e047cf5b60b1f086c10dfe42c4fd11602d1c1b8d89ee3ecdbddcb0a307fcb
Oct 30 20:47:32.577569 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.577526    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:32.577665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.577606    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:32.577665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:32.577642    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:33.008347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.008306    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" event={"ID":"67338f1c-e52a-40ed-a431-06614b480d8a","Type":"ContainerStarted","Data":"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"}
Oct 30 20:47:33.008530 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.008373    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" event={"ID":"67338f1c-e52a-40ed-a431-06614b480d8a","Type":"ContainerStarted","Data":"7b7a0d2ad7218d246969e02e5337a19761f015862ac773148320560bbff1f6a9"}
Oct 30 20:47:33.010296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.010263    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" event={"ID":"892fb78f-70d5-4b96-bb8e-101009d50b9b","Type":"ContainerStarted","Data":"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"}
Oct 30 20:47:33.010422 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.010322    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" event={"ID":"892fb78f-70d5-4b96-bb8e-101009d50b9b","Type":"ContainerStarted","Data":"c04e047cf5b60b1f086c10dfe42c4fd11602d1c1b8d89ee3ecdbddcb0a307fcb"}
Oct 30 20:47:33.127487 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.127432    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podStartSLOduration=2.127412925 podStartE2EDuration="2.127412925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:33.125276027 +0000 UTC m=+1219.117279156" watchObservedRunningTime="2026-10-30 20:47:33.127412925 +0000 UTC m=+1219.119416053"
Oct 30 20:47:33.132853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.132825    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:33.134326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.134288    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:33.134549 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.134351    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:33.245354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.244000    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podStartSLOduration=2.243982159 podStartE2EDuration="2.243982159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:33.243166083 +0000 UTC m=+1219.235169212" watchObservedRunningTime="2026-10-30 20:47:33.243982159 +0000 UTC m=+1219.235985287"
Oct 30 20:47:33.678471 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.678432    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:33.679540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.679520    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:33.679607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:33.679564    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:34.146161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:34.145290    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:34.146161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:34.145376    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:34.678691 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:34.678662    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:34.679136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:34.679004    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:35.138985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:35.138048    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:35.138985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:35.138108    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:35.678880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:35.678843    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:35.679277 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:35.678905    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:36.145935 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:36.145015    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:36.145935 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:36.145084    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:36.678959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:36.678907    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:36.679534 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:36.678986    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:37.145199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:37.143305    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:37.145199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:37.144047    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:37.678296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:37.678260    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:37.678554 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:37.678333    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:38.144307 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:38.143843    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:38.144307 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:38.143901    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:38.678887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:38.678851    5446 patch_prober.go:29] interesting pod/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 20:47:38.679073 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:38.678935    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 20:47:39.132188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:39.132155    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:47:39.132389 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:39.132214    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 20:47:40.052849 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.052822    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:40.053305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.053201    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:40.054159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.054137    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:47:40.303051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.302907    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:40.304195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.304145    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:40.308617 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:40.308597    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:47:44.124952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:44.119402    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:44.426001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:44.424048    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:44.663940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:44.643212    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:44.664300 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:44.664260    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:44.780000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:44.779005    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.018953 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.018879    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.091989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.088995    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.102948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.101992    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.103131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.103054    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.250783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.227271    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:47:45.250783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.248996    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": context deadline exceeded"
Oct 30 20:47:45.427193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.427151    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.531068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.531009    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.560079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.560001    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.646058 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.646016    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:45.646691 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.646666    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:47:45.676309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.676275    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 20:47:45.676831 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.676810    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:47:45.928861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.928768    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:47:45.932049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:45.931205    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:47:46.098978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.097886    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.098978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.098488    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:47:46.109072 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.100261    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.109072 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.102186    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.109072 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.108673    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:47:46.109072 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.108732    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:47:46.113516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.113491    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:47:46.119014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.118983    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.163932 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.163886    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:47:46.248435 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.248347    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:47:46.318756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.255745    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.320381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.320335    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:47:46.320523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.320509    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:47:46.532758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.532662    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.558957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.558090    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:47:46.584997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.560715    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.584997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.561838    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:47:46.741753 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.741700    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:46.963946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.953585    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:47:47.032935 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.872233    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:47:47.086936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:46.792265    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 20:47:47.123936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.121015    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:47.180607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.180563    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:47.257686 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.255965    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:47:47.274132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.274104    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:47:47.274392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.274377    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:47:47.274550 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.274538    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:47:47.276612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276588    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:47:47.276731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276647    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:47:47.276731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276679    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:47:47.276731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276719    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:47:47.276883 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276751    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:47:47.276883 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.276779    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:47:47.281901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.275905    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.285134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.285117    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:47:47.287213 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.286603    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:47:47.289195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.289177    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:47:47.365318 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365285    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.365804 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365366    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.365804 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365498    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.365904 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365827    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.366013 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365904    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.366013 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.365982    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.366176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.366155    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzpr5\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.366265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.366245    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.366631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.366483    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468153    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468216    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468326    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468353    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468385    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468436    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzpr5\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468461    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468550    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468556    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468641    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468730    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.468785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.468759    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.469253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.469236    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.469418 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.469396    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.471304 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.471285    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.471485 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.471466    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.526958 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.526865    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.527345 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.527329    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzpr5\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:47.614005 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:47.613978    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:48.047382 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:48.047357    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:47:48.049355 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:47:48.049325    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa0c662_83b8_4928_b47d_44da3cf6b608.slice/crio-9d33c9ba311afe974401e23e1b8c47e4a207cf428d22a4f107558273e4611e60 WatchSource:0}: Error finding container 9d33c9ba311afe974401e23e1b8c47e4a207cf428d22a4f107558273e4611e60: Status 404 returned error can't find the container with id 9d33c9ba311afe974401e23e1b8c47e4a207cf428d22a4f107558273e4611e60
Oct 30 20:47:48.052187 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:48.052156    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:48.052292 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:48.052237    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:48.052292 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:48.052282    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:47:49.051061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.051018    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" event={"ID":"6aa0c662-83b8-4928-b47d-44da3cf6b608","Type":"ContainerStarted","Data":"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"}
Oct 30 20:47:49.051528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.051097    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" event={"ID":"6aa0c662-83b8-4928-b47d-44da3cf6b608","Type":"ContainerStarted","Data":"9d33c9ba311afe974401e23e1b8c47e4a207cf428d22a4f107558273e4611e60"}
Oct 30 20:47:49.180643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.180598    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podStartSLOduration=4.180583758 podStartE2EDuration="4.180583758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:49.178393247 +0000 UTC m=+1235.170396374" watchObservedRunningTime="2026-10-30 20:47:49.180583758 +0000 UTC m=+1235.172586885"
Oct 30 20:47:49.542488 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:47:49.542443    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:47:49.618969 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.618932    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:49.619167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.619044    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:49.619167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:49.619080    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:50.614431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:50.614397    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:50.614851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:50.614452    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:51.614383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:51.614348    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:51.614572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:51.614402    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:52.620402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:52.620357    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:52.620956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:52.620436    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:53.614378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:53.614341    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:53.614687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:53.614654    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:54.614293 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:54.614259    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 20:47:54.614758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:54.614319    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 20:47:55.619089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:55.619058    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:55.619463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:55.619446    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:47:55.620147 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:47:55.620129    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:48:00.319482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.319447    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:48:00.323965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.323944    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.329279 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.329245    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkp7g\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.329597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.329577    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.329776 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.329759    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.329963 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.329938    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.330089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.330010    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.330196 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.330174    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.330274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.330218    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.330274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.330245    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.330404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.330315    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.430962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.430873    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:48:00.431296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431268    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431307    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431323    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431350    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431555 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431393    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkp7g\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431555 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431479    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431555 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431526    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431570    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431632    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431726    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.431813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.431769    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.432102 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.432076    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.432288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.432254    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.432862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.432839    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.434079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.434056    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.434526 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.434504    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.490012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.489979    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.491391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.491365    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkp7g\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\") pod \"e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") " pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.551422 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.551398    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:48:00.556327 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.556309    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.616312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.616288    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:48:00.634298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634272    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634432 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634310    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634432 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634331    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634432 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634402    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634546    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634720    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gj4r\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634792 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634755    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634792 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634776    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.634988 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.634965    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.649710 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.649688    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:00.736598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736563    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gj4r\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736644    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736671    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736846 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736764    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736846 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736810    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736844    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736879    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.736982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.736929    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.737118 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.737000    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.737405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.737376    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.737516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.737410    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.738329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.738145    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.738329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.738277    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.738329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.738282    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.740432 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.740408    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.740720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.740698    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.795351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.795326    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gj4r\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.796968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.796945    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:00.870699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:00.870642    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:01.092521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.092495    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:48:01.094240 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:01.094213    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24bfd77_163f_44ed_85bd_1183caf372fa.slice/crio-957725e222c4c253aa19dc259ba5e961a843f438cd7717fcb0387a2daff40277 WatchSource:0}: Error finding container 957725e222c4c253aa19dc259ba5e961a843f438cd7717fcb0387a2daff40277: Status 404 returned error can't find the container with id 957725e222c4c253aa19dc259ba5e961a843f438cd7717fcb0387a2daff40277
Oct 30 20:48:01.097362 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.097320    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:01.097470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.097410    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:01.097470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.097450    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:01.144749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.144717    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" event={"ID":"e24bfd77-163f-44ed-85bd-1183caf372fa","Type":"ContainerStarted","Data":"957725e222c4c253aa19dc259ba5e961a843f438cd7717fcb0387a2daff40277"}
Oct 30 20:48:01.254565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.254530    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:48:01.256017 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:01.255987    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b97502a_e0a0_4316_8eb0_8a2e3d20c1a5.slice/crio-010726fbf67c46fa2a68f6942093697cd28c12b94328c97254928142872afde6 WatchSource:0}: Error finding container 010726fbf67c46fa2a68f6942093697cd28c12b94328c97254928142872afde6: Status 404 returned error can't find the container with id 010726fbf67c46fa2a68f6942093697cd28c12b94328c97254928142872afde6
Oct 30 20:48:01.258659 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.258623    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:01.258749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.258699    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:01.258749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:01.258739    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:02.155170 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.154471    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" event={"ID":"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5","Type":"ContainerStarted","Data":"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"}
Oct 30 20:48:02.155170 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.154527    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" event={"ID":"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5","Type":"ContainerStarted","Data":"010726fbf67c46fa2a68f6942093697cd28c12b94328c97254928142872afde6"}
Oct 30 20:48:02.156799 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.156769    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" event={"ID":"e24bfd77-163f-44ed-85bd-1183caf372fa","Type":"ContainerStarted","Data":"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"}
Oct 30 20:48:02.377421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.377357    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podStartSLOduration=2.37734276 podStartE2EDuration="2.37734276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:02.326433886 +0000 UTC m=+1248.318437014" watchObservedRunningTime="2026-10-30 20:48:02.37734276 +0000 UTC m=+1248.369345958"
Oct 30 20:48:02.447883 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.447778    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podStartSLOduration=2.447763127 podStartE2EDuration="2.447763127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:02.444825835 +0000 UTC m=+1248.436828962" watchObservedRunningTime="2026-10-30 20:48:02.447763127 +0000 UTC m=+1248.439766253"
Oct 30 20:48:02.650392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.650346    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:02.651511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.651490    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:02.651570 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.651535    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:02.871825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.871785    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:02.872955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.872898    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:02.873031 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:02.872980    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:03.650514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:03.650477    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:03.650950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:03.650531    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:03.871560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:03.871521    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:03.871731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:03.871578    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:04.650196 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:04.650166    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:04.650418 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:04.650245    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:04.871701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:04.871664    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:04.872127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:04.871719    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:05.650514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:05.650472    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:05.650700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:05.650532    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:05.871549 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:05.871514    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:05.871722 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:05.871566    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:06.650408 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:06.650373    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:06.650595 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:06.650429    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:06.870975 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:06.870942    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:06.871163 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:06.871062    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:07.650198 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:07.650151    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:48:07.650685 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:07.650656    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 20:48:07.871264 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:07.871226    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:48:07.871455 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:07.871298    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 20:48:08.655497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.655462    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:08.655909 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.655890    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:08.656666 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.656643    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:48:08.876257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.876227    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:08.876560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.876519    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:08.877304 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:08.877286    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:48:17.139847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.139815    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7206-c31885"]
Oct 30 20:48:17.145302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.145280    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:17.202067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.202044    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7206-c31885"]
Oct 30 20:48:17.247324 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.247297    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nvzb9\""
Oct 30 20:48:17.249144 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.249121    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-strpf\" (UniqueName: \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\") pod \"test-curl-7206-c31885\" (UID: \"08a8c2ad-9dd1-46ce-a022-aa2830017e36\") " pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:17.350157 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.350134    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-strpf\" (UniqueName: \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\") pod \"test-curl-7206-c31885\" (UID: \"08a8c2ad-9dd1-46ce-a022-aa2830017e36\") " pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:17.409972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.409869    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-strpf\" (UniqueName: \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\") pod \"test-curl-7206-c31885\" (UID: \"08a8c2ad-9dd1-46ce-a022-aa2830017e36\") " pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:17.465235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.465196    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:17.869219 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.869192    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7206-c31885"]
Oct 30 20:48:17.872048 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:17.872011    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08a8c2ad_9dd1_46ce_a022_aa2830017e36.slice/crio-784ea00b014f0e933fc4d896fb0e4868066af9ad1c517bba170d01f9af022ae0 WatchSource:0}: Error finding container 784ea00b014f0e933fc4d896fb0e4868066af9ad1c517bba170d01f9af022ae0: Status 404 returned error can't find the container with id 784ea00b014f0e933fc4d896fb0e4868066af9ad1c517bba170d01f9af022ae0
Oct 30 20:48:17.874775 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:17.874752    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:48:18.435940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:18.430787    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7206-c31885" event={"ID":"08a8c2ad-9dd1-46ce-a022-aa2830017e36","Type":"ContainerStarted","Data":"784ea00b014f0e933fc4d896fb0e4868066af9ad1c517bba170d01f9af022ae0"}
Oct 30 20:48:19.150943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.148016    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.150943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.148502    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:48:19.170951 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.168024    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:48:19.237386 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.237340    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.242057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.242013    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.289136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.287095    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.289136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.287484    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:48:19.289136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.288520    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.290271 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.290009    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.422667 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:19.422099    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:19.841999 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:19.832834    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:48:20.039945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.039088    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.039945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.039449    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:48:20.096993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.096462    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.152944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.152501    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.152944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.152839    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:48:20.168942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.165581    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:48:20.168942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.165644    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:48:20.189936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.179045    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.189936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.181988    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.189936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.182339    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:48:20.241945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.240043    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.241945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.240391    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:48:20.256908 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.256873    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.257616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.257595    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:48:20.293093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.293052    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.296942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.293341    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:20.325289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.293367    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Oct 30 20:48:20.328942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.293390    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:48:20.329374 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.294034    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:48:20.329630 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.329611    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:48:20.329776 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.329764    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:48:20.334021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:20.334001    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:48:21.064983 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.057022    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.141945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.140218    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:48:21.224949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.179981    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:48:21.224949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.180285    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.238942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.225884    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:48:21.242958 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.239216    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": context deadline exceeded"
Oct 30 20:48:21.243719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.243697    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:48:21.244152 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.244135    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:48:21.244314 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.244302    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:48:21.246156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.246130    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.253154    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.253222    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.325901    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.257548    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.334250    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.336982    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:21.383901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:21.297487    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 20:48:22.185131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.184067    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:22.222947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.185815    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:22.222947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.186186    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:22.572321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.572212    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:48:22.600376 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.600316    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:22.672429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.633630    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:22.900565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.708084    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.773570    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.848080    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.848140    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.848179    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.848213    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.027943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:22.848258    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.100890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.099396    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:48:23.100890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.099480    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.200152 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.200044    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.249940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.213561    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.371374 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.213521    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.914214 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.464275    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:48:23.914507 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.914475    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.914693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.624602    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:48:23.963167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.591828    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.963167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.669948    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/echo-simulator-kserve-64b6f8f96c-mn78n" podUID="eff48eb3-c498-4663-a094-7f4fed6b8027" containerName="main" probeResult="failure" output="Get \"https://10.133.0.35:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:23.963167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:23.672678    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:24.051295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.049114    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:24.147936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.144879    5446 patch_prober.go:29] interesting pod/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:48:24.147936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.144961    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:24.191021 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:24.188955    5446 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="2.005s"
Oct 30 20:48:24.269939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.269432    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.285305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.272863    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.305511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.305476    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:48:24.384046 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.306241    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.418855 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.306291    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.445057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.306667    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.577812 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.577765    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:48:24.647641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.647613    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.676810    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.676900    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.676965    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.677001    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.677041    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.677078    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.677108    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:48:24.682947 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.677145    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 20:48:24.690677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.684960    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:48:24.690677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.685538    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:48:24.690677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:24.686721    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:48:26.536711 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:26.536674    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7206-c31885" event={"ID":"08a8c2ad-9dd1-46ce-a022-aa2830017e36","Type":"ContainerStarted","Data":"1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e"}
Oct 30 20:48:26.655565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:26.655465    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7206-c31885" podStartSLOduration=1.162619072 podStartE2EDuration="9.655449405s" totalImagesPullingTime="8.492830333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:26.653681809 +0000 UTC m=+1272.645684937" watchObservedRunningTime="2026-10-30 20:48:26.655449405 +0000 UTC m=+1272.647452531"
Oct 30 20:48:28.157710 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.157679    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7206-c31885"]
Oct 30 20:48:28.171422 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.171388    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7206-c31885"]
Oct 30 20:48:28.207861 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.207824    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:48:28.208765 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.208740    5446 cpu_manager.go:414] "containerMap: removing container" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" containerName="test-curl-7206-c31885"
Oct 30 20:48:28.208961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.208944    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" containerName="test-curl-7206-c31885"
Oct 30 20:48:28.209328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.209312    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" containerName="test-curl-7206-c31885"
Oct 30 20:48:28.213544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.213517    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.243959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.243903    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244017    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244133    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n78x6\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244294    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244375    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244524    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244675 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244564    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244675 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244642    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.244958 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.244862    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.266828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.266803    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dc0e9f64-gw-openshift-default-dockercfg-7llj5\""
Oct 30 20:48:28.284122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.281192    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:48:28.340908 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.340882    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7206-6cf04b"]
Oct 30 20:48:28.345268 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.345238    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:28.345830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.345808    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.345959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.345853    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.345959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.345895    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346041    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346162    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346256    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346270    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346286    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78x6\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346304    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346369    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346382    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346473    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.346675 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.346546    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.347067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.347046    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.348484 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.348464    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.348554 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.348517    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.408637 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.405011    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7206-6cf04b"]
Oct 30 20:48:28.421972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.421939    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78x6\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.423941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.423882    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\") pod \"e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") " pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.448115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.448087    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx9lb\" (UniqueName: \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\") pod \"test-curl-7206-6cf04b\" (UID: \"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7\") " pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:28.538450 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.538421    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:28.551447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.549546    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx9lb\" (UniqueName: \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\") pod \"test-curl-7206-6cf04b\" (UID: \"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7\") " pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:28.558328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.558291    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7206-c31885" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" containerName="test-curl-7206-c31885" containerID="cri-o://1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e" gracePeriod=2
Oct 30 20:48:28.641940 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:28.640943    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-c31885\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:28.642704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.642545    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx9lb\" (UniqueName: \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\") pod \"test-curl-7206-6cf04b\" (UID: \"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7\") " pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:28.670911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:28.670840    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:29.012778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.012706    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:48:29.051169 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:29.051125    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcabfdac_bf51_4642_92c3_c88883c759a0.slice/crio-8294b6fc856cd8567e6e0d415a7fee10f1ee46986b82d94e807d01ddd9ce7e70 WatchSource:0}: Error finding container 8294b6fc856cd8567e6e0d415a7fee10f1ee46986b82d94e807d01ddd9ce7e70: Status 404 returned error can't find the container with id 8294b6fc856cd8567e6e0d415a7fee10f1ee46986b82d94e807d01ddd9ce7e70
Oct 30 20:48:29.054060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.054026    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:29.054148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.054096    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:29.054148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.054123    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:29.064871 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.064840    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7206-6cf04b"]
Oct 30 20:48:29.073799 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:29.073771    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fa90cef_07b0_4e1d_bd3c_ae5b53f79aa7.slice/crio-62432b3a90644775872fdac9e9e189d9e0e2de900f8b22c995b49ec65ea2cd91 WatchSource:0}: Error finding container 62432b3a90644775872fdac9e9e189d9e0e2de900f8b22c995b49ec65ea2cd91: Status 404 returned error can't find the container with id 62432b3a90644775872fdac9e9e189d9e0e2de900f8b22c995b49ec65ea2cd91
Oct 30 20:48:29.566848 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.566813    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerStarted","Data":"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"}
Oct 30 20:48:29.567327 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.566869    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerStarted","Data":"8294b6fc856cd8567e6e0d415a7fee10f1ee46986b82d94e807d01ddd9ce7e70"}
Oct 30 20:48:29.569685 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.569642    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7206-6cf04b" event={"ID":"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7","Type":"ContainerStarted","Data":"b27e8d6cbf653b6748c77356f21bad1832af4feb597ac8e8e8389d3b54e4368c"}
Oct 30 20:48:29.569820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.569699    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7206-6cf04b" event={"ID":"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7","Type":"ContainerStarted","Data":"62432b3a90644775872fdac9e9e189d9e0e2de900f8b22c995b49ec65ea2cd91"}
Oct 30 20:48:29.686735 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.686683    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podStartSLOduration=1.6866692319999999 podStartE2EDuration="1.686669232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:29.68463009 +0000 UTC m=+1275.676633217" watchObservedRunningTime="2026-10-30 20:48:29.686669232 +0000 UTC m=+1275.678672359"
Oct 30 20:48:29.735392 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:29.735347    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-c31885\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:29.786129 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:29.786091    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-c31885\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:29.903378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:29.903319    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7206-6cf04b" podStartSLOduration=1.903300985 podStartE2EDuration="1.903300985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:29.898079844 +0000 UTC m=+1275.890082983" watchObservedRunningTime="2026-10-30 20:48:29.903300985 +0000 UTC m=+1275.895304112"
Oct 30 20:48:30.538856 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.538811    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:30.543966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.543938    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:30.578491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.578458    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:30.579204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.579187    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:48:30.823294 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.823269    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:30.887126 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.887095    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\" (UniqueName: \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\") pod \"08a8c2ad-9dd1-46ce-a022-aa2830017e36\" (UID: \"08a8c2ad-9dd1-46ce-a022-aa2830017e36\") "
Oct 30 20:48:30.889329 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.889305    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf" pod "08a8c2ad-9dd1-46ce-a022-aa2830017e36" (UID: "08a8c2ad-9dd1-46ce-a022-aa2830017e36"). InnerVolumeSpecName "kube-api-access-strpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:30.989637 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.989600    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:48:30.996953 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.996226    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:30.997583 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:30.997551    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-strpf\" (UniqueName: \"kubernetes.io/projected/08a8c2ad-9dd1-46ce-a022-aa2830017e36-kube-api-access-strpf\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:31.056765 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.056671    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f9782c31-openshift-default-dockercfg-cs5ql\""
Oct 30 20:48:31.093647 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.093599    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:48:31.101090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101056    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101241 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101113    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101241 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101210    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101248    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101274    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5vh\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101315    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101424    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101508    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.101545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.101540    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203075    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203126    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203157    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203179    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5vh\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203218    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203384    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203487    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203514    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203532    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203575    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203608    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203653    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.203888 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.203761    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.204114 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.204089    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.206156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.206130    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.206301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.206284    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.270942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.266266    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.270942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.267602    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5vh\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\") pod \"e2e-ait-f9782c31-openshift-default-84f68d447-647nj\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") " pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.312766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.312687    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:31.568221 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.568087    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7206-6cf04b"]
Oct 30 20:48:31.573210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.573181    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7206-6cf04b"]
Oct 30 20:48:31.587566 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.587538    5446 generic.go:356] "Generic (PLEG): container finished" podID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" containerID="1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e" exitCode=137
Oct 30 20:48:31.588010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.587589    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:31.588010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.587633    5446 scope.go:122] "RemoveContainer" containerID="1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e"
Oct 30 20:48:31.588010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.587825    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7206-6cf04b" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" containerName="test-curl-7206-6cf04b" containerID="cri-o://b27e8d6cbf653b6748c77356f21bad1832af4feb597ac8e8e8389d3b54e4368c" gracePeriod=2
Oct 30 20:48:31.600634 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.600570    5446 scope.go:122] "RemoveContainer" containerID="1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e"
Oct 30 20:48:31.600904 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:31.600881    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e\": container with ID starting with 1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e not found: ID does not exist" containerID="1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e"
Oct 30 20:48:31.601001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.600933    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e"} err="failed to get container status \"1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e\": rpc error: code = NotFound desc = could not find container \"1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e\": container with ID starting with 1fa1e65fa583dc759c7eb578dcee3b95da8475762ad863661df44d0e17234f8e not found: ID does not exist"
Oct 30 20:48:31.638235 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:31.638204    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-6cf04b\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:31.688716 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:31.688673    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-c31885\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" pod="opendatahub/test-curl-7206-c31885"
Oct 30 20:48:31.739204 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:31.739167    5446 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7206-6cf04b\" is forbidden: User \"system:node:ip-10-0-135-188.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-188.us-west-1.compute.internal' and this object" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:31.758709 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.758682    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:48:31.760415 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:31.760389    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cfc5f2_6f66_4880_8d4e_6a40eed6c094.slice/crio-8052f6cd20d0aed300c6b0e109cf49d999f46a6ede329d9e4d9bf07567cf0c1e WatchSource:0}: Error finding container 8052f6cd20d0aed300c6b0e109cf49d999f46a6ede329d9e4d9bf07567cf0c1e: Status 404 returned error can't find the container with id 8052f6cd20d0aed300c6b0e109cf49d999f46a6ede329d9e4d9bf07567cf0c1e
Oct 30 20:48:31.763076 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.763042    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:31.763177 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.763118    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:31.763177 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:31.763161    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:32.121340 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:32.121313    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08a8c2ad-9dd1-46ce-a022-aa2830017e36" path="/var/lib/kubelet/pods/08a8c2ad-9dd1-46ce-a022-aa2830017e36/volumes"
Oct 30 20:48:32.596287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:32.596204    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerStarted","Data":"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"}
Oct 30 20:48:32.596287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:32.596254    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerStarted","Data":"8052f6cd20d0aed300c6b0e109cf49d999f46a6ede329d9e4d9bf07567cf0c1e"}
Oct 30 20:48:32.718570 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:32.718528    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podStartSLOduration=2.718514123 podStartE2EDuration="2.718514123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:32.716374594 +0000 UTC m=+1278.708377721" watchObservedRunningTime="2026-10-30 20:48:32.718514123 +0000 UTC m=+1278.710517250"
Oct 30 20:48:33.313428 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.313397    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:33.319412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.319386    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:33.618951 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.618901    5446 generic.go:356] "Generic (PLEG): container finished" podID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" containerID="b27e8d6cbf653b6748c77356f21bad1832af4feb597ac8e8e8389d3b54e4368c" exitCode=137
Oct 30 20:48:33.619600 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.619575    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:33.620961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.620900    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:48:33.837389 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.837362    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:33.946128 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.946096    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\" (UniqueName: \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\") pod \"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7\" (UID: \"6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7\") "
Oct 30 20:48:33.948478 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:33.948450    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb" pod "6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" (UID: "6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7"). InnerVolumeSpecName "kube-api-access-vx9lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:34.048733 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:34.048707    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx9lb\" (UniqueName: \"kubernetes.io/projected/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7-kube-api-access-vx9lb\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:34.121618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:34.121590    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" path="/var/lib/kubelet/pods/6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7/volumes"
Oct 30 20:48:34.628726 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:34.628696    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7206-6cf04b"
Oct 30 20:48:34.629275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:34.629010    5446 scope.go:122] "RemoveContainer" containerID="b27e8d6cbf653b6748c77356f21bad1832af4feb597ac8e8e8389d3b54e4368c"
Oct 30 20:48:35.911972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.911940    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:48:35.912631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.912616    5446 cpu_manager.go:414] "containerMap: removing container" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" containerName="test-curl-7206-6cf04b"
Oct 30 20:48:35.912677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.912633    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" containerName="test-curl-7206-6cf04b"
Oct 30 20:48:35.912750 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.912741    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fa90cef-07b0-4e1d-bd3c-ae5b53f79aa7" containerName="test-curl-7206-6cf04b"
Oct 30 20:48:35.917333 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.917315    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:35.975626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.975473    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:48:35.977636 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.977604    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:35.977786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:35.977644    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7n7\" (UniqueName: \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.026840 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.019979    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-dc0e9f64-dockercfg-fcgsv\""
Oct 30 20:48:36.026840 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.020125    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-dc0e9f64\""
Oct 30 20:48:36.079256 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.079224    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.079479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.079335    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7n7\" (UniqueName: \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.080127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.080097    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.138308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.138281    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7n7\" (UniqueName: \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\") pod \"payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.230985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.230866    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:36.609850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.609829    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:48:36.612155 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:36.612119    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c59e125_dbac_46a0_a5d1_f04dd4248b77.slice/crio-0c3f7a4896faf626e5933806841a7bdff72de9c79a664e659daf59b990af0bdc WatchSource:0}: Error finding container 0c3f7a4896faf626e5933806841a7bdff72de9c79a664e659daf59b990af0bdc: Status 404 returned error can't find the container with id 0c3f7a4896faf626e5933806841a7bdff72de9c79a664e659daf59b990af0bdc
Oct 30 20:48:36.647843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:36.647814    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" event={"ID":"6c59e125-dbac-46a0-a5d1-f04dd4248b77","Type":"ContainerStarted","Data":"0c3f7a4896faf626e5933806841a7bdff72de9c79a664e659daf59b990af0bdc"}
Oct 30 20:48:37.656038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:37.656004    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" event={"ID":"6c59e125-dbac-46a0-a5d1-f04dd4248b77","Type":"ContainerStarted","Data":"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"}
Oct 30 20:48:37.656485 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:37.656156    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:37.775241 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:37.775168    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" podStartSLOduration=2.7751483820000002 podStartE2EDuration="2.775148382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:37.771525087 +0000 UTC m=+1283.763528217" watchObservedRunningTime="2026-10-30 20:48:37.775148382 +0000 UTC m=+1283.767151512"
Oct 30 20:48:40.708862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.707390    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:48:40.719524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.719489    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:40.768559 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.768530    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:48:40.825224 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.825192    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f9782c31\""
Oct 30 20:48:40.825576 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.825501    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f9782c31-dockercfg-7qz2q\""
Oct 30 20:48:40.830309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.830283    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:48:40.834700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.834679    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:40.863253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.863223    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:40.863398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.863377    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zxr\" (UniqueName: \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:40.898866 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.898829    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:48:40.965418 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.965338    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:40.965573 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.965479    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:40.965645 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.965621    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zxr\" (UniqueName: \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:40.965780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.965762    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkkk7\" (UniqueName: \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:40.966160 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:40.966144    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:41.031880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.031845    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zxr\" (UniqueName: \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\") pod \"payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:41.034016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.033987    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:41.068336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.068302    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.068468 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.068434    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkkk7\" (UniqueName: \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.069410 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.069384    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.137962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.128554    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkkk7\" (UniqueName: \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\") pod \"payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") " pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.190531 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.176705    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.436079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.436048    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:48:41.436680 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:41.436657    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f2b9f6_81f6_4c8f_a940_306543ccacae.slice/crio-132507b2f8e1cede3d09b384bf35323f6a8fc86cdd9ad9aa39e60b61fe6be4a9 WatchSource:0}: Error finding container 132507b2f8e1cede3d09b384bf35323f6a8fc86cdd9ad9aa39e60b61fe6be4a9: Status 404 returned error can't find the container with id 132507b2f8e1cede3d09b384bf35323f6a8fc86cdd9ad9aa39e60b61fe6be4a9
Oct 30 20:48:41.595654 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.595629    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:48:41.596297 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:41.596276    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50dc5c7e_e282_442a_ae87_08d73ba8bc64.slice/crio-2a9ebbd83bbde66c90937a61e982a67a4099f9a641a43774cc255238acdae286 WatchSource:0}: Error finding container 2a9ebbd83bbde66c90937a61e982a67a4099f9a641a43774cc255238acdae286: Status 404 returned error can't find the container with id 2a9ebbd83bbde66c90937a61e982a67a4099f9a641a43774cc255238acdae286
Oct 30 20:48:41.687235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.687203    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" event={"ID":"95f2b9f6-81f6-4c8f-a940-306543ccacae","Type":"ContainerStarted","Data":"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"}
Oct 30 20:48:41.687343 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.687268    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" event={"ID":"95f2b9f6-81f6-4c8f-a940-306543ccacae","Type":"ContainerStarted","Data":"132507b2f8e1cede3d09b384bf35323f6a8fc86cdd9ad9aa39e60b61fe6be4a9"}
Oct 30 20:48:41.687343 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.687297    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:41.688930 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.688894    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" event={"ID":"50dc5c7e-e282-442a-ae87-08d73ba8bc64","Type":"ContainerStarted","Data":"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"}
Oct 30 20:48:41.689044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.688948    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" event={"ID":"50dc5c7e-e282-442a-ae87-08d73ba8bc64","Type":"ContainerStarted","Data":"2a9ebbd83bbde66c90937a61e982a67a4099f9a641a43774cc255238acdae286"}
Oct 30 20:48:41.689044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.688986    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:41.811153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.811070    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" podStartSLOduration=1.81105653 podStartE2EDuration="1.81105653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:41.807422181 +0000 UTC m=+1287.799425307" watchObservedRunningTime="2026-10-30 20:48:41.81105653 +0000 UTC m=+1287.803059658"
Oct 30 20:48:41.925066 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:41.925017    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" podStartSLOduration=1.92500183 podStartE2EDuration="1.92500183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:41.922736606 +0000 UTC m=+1287.914739734" watchObservedRunningTime="2026-10-30 20:48:41.92500183 +0000 UTC m=+1287.917004956"
Oct 30 20:48:42.891330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:42.891299    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 20:48:42.895892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:42.895869    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:42.951304 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:42.951284    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 20:48:42.951625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:42.951607    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 20:48:42.951693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:42.951658    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jmh9r\""
Oct 30 20:48:43.002199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.000850    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 20:48:43.006215 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.006160    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 20:48:43.008448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008404    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.008448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008450    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.009879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008572    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdt6\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.009879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008632    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.009879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008680    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.009879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008717    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.009879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.008821    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.110716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.110679    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdt6\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.110886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.110736    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.110886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.110772    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.110886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.110794    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.110886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.110881    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.111132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.111069    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.111132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.111099    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.112118 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.112083    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.113971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.113946    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.114159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.114017    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.114276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.114172    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.115332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.115312    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.176065 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.175998    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.176196 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.176096    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdt6\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qx2lc\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.209946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.209901    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:43.698444 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.698413    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 20:48:43.699392 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:43.699366    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6415dd_c90a_4c98_b68d_d6959d925a04.slice/crio-63ff3dc653de54ca9b504b1d4fdae36176a6457e3a01d0b9b8703b6d57e54b6d WatchSource:0}: Error finding container 63ff3dc653de54ca9b504b1d4fdae36176a6457e3a01d0b9b8703b6d57e54b6d: Status 404 returned error can't find the container with id 63ff3dc653de54ca9b504b1d4fdae36176a6457e3a01d0b9b8703b6d57e54b6d
Oct 30 20:48:43.702210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.702176    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:43.702311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:43.702251    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:44.711236 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.711204    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" event={"ID":"7e6415dd-c90a-4c98-b68d-d6959d925a04","Type":"ContainerStarted","Data":"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"}
Oct 30 20:48:44.711721 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.711259    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:44.711721 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.711279    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" event={"ID":"7e6415dd-c90a-4c98-b68d-d6959d925a04","Type":"ContainerStarted","Data":"63ff3dc653de54ca9b504b1d4fdae36176a6457e3a01d0b9b8703b6d57e54b6d"}
Oct 30 20:48:44.712875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.712839    5446 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-qx2lc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:48:44.713006 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.712909    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:48:44.918845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:44.918793    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" podStartSLOduration=2.9187794929999997 podStartE2EDuration="2.918779493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:44.915856774 +0000 UTC m=+1290.907859900" watchObservedRunningTime="2026-10-30 20:48:44.918779493 +0000 UTC m=+1290.910782619"
Oct 30 20:48:45.742658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:45.742602    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 20:48:45.963091 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:45.963058    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:48:45.967396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:45.967377    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.028506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.028433    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:48:46.062514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.062482    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.062679 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.062557    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.062771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.062742    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.062968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.062947    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.063059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.063047    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.063117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.063072    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.063117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.063105    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.063274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.063255    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmjzf\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.063336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.063307    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.165490 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.165451    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.165773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.165749    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166047 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166027    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166242    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166370    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166508    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166673 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166657    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmjzf\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.166787 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.166771    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.167054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.167023    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.174520    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.184473    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.184725    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.184986    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.185559    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.186330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.185829    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.221330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.221191    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.241272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.241246    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.254198 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.254167    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmjzf\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\") pod \"e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") " pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.284787 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.284712    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:46.414970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.414428    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:48:46.426275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.426247    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.472599 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.472567    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.472768 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.472684    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.472845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.472830    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.472972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.472941    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.473122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.473048    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psl9k\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.473185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.473126    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.473248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.473194    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.473360 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.473324    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.473450 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.473382    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.488684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.488655    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:48:46.575086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575005    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575075    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575161    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575226    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575343    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575436    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575469    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psl9k\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575497    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575518    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575551    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575556    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.575826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.575793    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.576086 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.576067    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.576209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.576190    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.578142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.578119    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.578259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.578235    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.637797 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.637764    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psl9k\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.638106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.637883    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\") pod \"e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") " pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:46.738425 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.738390    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:48:46.740260 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:46.739464    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a29bb5_b348_40bc_ac04_8e69f48c640e.slice/crio-d287f92678811a176f288061c2cfcf9bd4490969756c9eaea46c278f077e1942 WatchSource:0}: Error finding container d287f92678811a176f288061c2cfcf9bd4490969756c9eaea46c278f077e1942: Status 404 returned error can't find the container with id d287f92678811a176f288061c2cfcf9bd4490969756c9eaea46c278f077e1942
Oct 30 20:48:46.743318 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.743275    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:46.743717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.743343    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:46.743717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.743372    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:46.743886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:46.743846    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:47.201095 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.201065    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:48:47.201470 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:48:47.201448    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0901e870_2a60_4ad1_b78a_21b1514022b1.slice/crio-3d4b0a6eb49dbc27881604c04b6be187e502207804b5f224447e761a28ca259c WatchSource:0}: Error finding container 3d4b0a6eb49dbc27881604c04b6be187e502207804b5f224447e761a28ca259c: Status 404 returned error can't find the container with id 3d4b0a6eb49dbc27881604c04b6be187e502207804b5f224447e761a28ca259c
Oct 30 20:48:47.204474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.204444    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:47.204547 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.204509    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:47.204588 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.204548    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:47.756879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.756839    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" event={"ID":"0901e870-2a60-4ad1-b78a-21b1514022b1","Type":"ContainerStarted","Data":"84e4456ef5d86851fd44de0e982e0cc6747c1703bbf0da3630d7edc52395d218"}
Oct 30 20:48:47.757405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.756901    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" event={"ID":"0901e870-2a60-4ad1-b78a-21b1514022b1","Type":"ContainerStarted","Data":"3d4b0a6eb49dbc27881604c04b6be187e502207804b5f224447e761a28ca259c"}
Oct 30 20:48:47.758630 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.758593    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" event={"ID":"74a29bb5-b348-40bc-ac04-8e69f48c640e","Type":"ContainerStarted","Data":"a6151993a893ec476155ea0c04b4a8a52358a79aa29c7ee7c38291ede3e548e5"}
Oct 30 20:48:47.758723 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.758650    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" event={"ID":"74a29bb5-b348-40bc-ac04-8e69f48c640e","Type":"ContainerStarted","Data":"d287f92678811a176f288061c2cfcf9bd4490969756c9eaea46c278f077e1942"}
Oct 30 20:48:47.883410 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:47.882626    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podStartSLOduration=1.882612901 podStartE2EDuration="1.882612901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:47.879328071 +0000 UTC m=+1293.871331208" watchObservedRunningTime="2026-10-30 20:48:47.882612901 +0000 UTC m=+1293.874616028"
Oct 30 20:48:48.028310 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.028180    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podStartSLOduration=3.028158749 podStartE2EDuration="3.028158749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:48.003224601 +0000 UTC m=+1293.995227731" watchObservedRunningTime="2026-10-30 20:48:48.028158749 +0000 UTC m=+1294.020161876"
Oct 30 20:48:48.284962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.284856    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:48.286566 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.286540    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:48.286838 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.286815    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:48.665806 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.665780    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:48:48.745989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.745168    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:48.746594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.746570    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:48.746714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:48.746624    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:49.285119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:49.285087    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:49.285580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:49.285135    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:49.563460 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:48:49.563373    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:48:49.744393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:49.744356    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:49.744572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:49.744406    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:50.285242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:50.285209    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:50.285653 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:50.285257    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:50.744891 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:50.744505    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:50.744891 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:50.744551    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:51.285944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:51.285894    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:51.286365 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:51.285950    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:51.750020 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:51.747408    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:51.750020 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:51.747472    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:52.285004 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.284968    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:52.285178 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.285014    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:52.740354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.739359    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:48:52.740722 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.740373    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:48:52.744602 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.744576    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:52.744738 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:52.744638    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:53.286188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:53.286100    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Oct 30 20:48:53.286188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:53.286180    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Oct 30 20:48:53.744293 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:53.744255    5446 patch_prober.go:29] interesting pod/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Oct 30 20:48:53.744657 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:53.744331    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Oct 30 20:48:54.299699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.299664    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:54.300106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.300070    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:54.301188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.301161    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:48:54.748954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.748906    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:54.749731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.749700    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:48:54.750256 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:48:54.750235    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:49:05.582954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:05.570042    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:05.631944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:05.631098    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:05.635954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:05.633002    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:05.727945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:05.715984    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.042063 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.042014    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5" podUID="47fb9715-f515-4d27-9657-00908b6e3de3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.29:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.215971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.189712    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.215971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.190714    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.400962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.378278    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.400962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.378543    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.400962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.380782    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.541943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.378849    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:06.596375 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.596326    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.622943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.598162    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:49:06.692015 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.680801    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.692015 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.682221    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:49:06.735188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.702712    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.735188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.719909    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.735188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.721431    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:49:06.735188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.722560    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:49:06.735188 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:06.722822    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:49:07.197117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.197052    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:07.200936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.198459    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:49:07.200936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.199839    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:07.200936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.200228    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:49:07.423199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.423160    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:49:07.426933 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.424164    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:49:07.427467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.424234    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:49:07.428049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.428034    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:49:07.428275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.428262    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:49:07.510303 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.510223    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:49:07.537481 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.537450    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:49:07.546790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.546768    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:49:07.547021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.547008    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:49:07.548254 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.548233    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:49:07.567698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.567677    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 20:49:07.580161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:07.580094    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:49:19.518998 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:49:19.518957    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:49:43.230616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.230588    5446 generic.go:356] "Generic (PLEG): container finished" podID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerID="3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9" exitCode=0
Oct 30 20:49:43.231093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.230660    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerDied","Data":"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"}
Oct 30 20:49:43.231158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.231094    5446 scope.go:122] "RemoveContainer" containerID="3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"
Oct 30 20:49:43.232542 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.232514    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:49:43.232634 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.232597    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:49:43.232700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:43.232647    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:49:44.240804 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:44.240769    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerStarted","Data":"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"}
Oct 30 20:49:44.539038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:44.538941    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:49:44.543307 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:44.543274    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:44.543476 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:44.543337    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:45.538972 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:45.538904    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:45.539367 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:45.539003    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:45.578302 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:45.578273    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:49:46.539172 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:46.539142    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:46.539584 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:46.539191    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:47.539455 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:47.539420    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:47.539895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:47.539493    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:48.539344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:48.539311    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:48.539533 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:48.539385    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:49.538971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:49.538931    5446 patch_prober.go:29] interesting pod/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Oct 30 20:49:49.539147 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:49.539011    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Oct 30 20:49:49.550564 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:49:49.550526    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:49:50.543369 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:50.543339    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:49:50.544387 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:49:50.544368    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:50:19.543130 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:50:19.543093    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:50:27.573364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.573332    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:50:27.617887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.579126    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.681646 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.681620    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-78ca07a3-openshift-default-dockercfg-2f4mk\""
Oct 30 20:50:27.686208 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.686180    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:50:27.717294 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717267    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csfvd\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717427 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717337    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717516 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717489    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717559 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717541    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717727 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717703    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717831    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.717900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717872    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.718050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.717947    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.718171 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.718132    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819285    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819331    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819483 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819420    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819483 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819462    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819596 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819500    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819596 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819528    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819708 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819602    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819708 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819675    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csfvd\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819720    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819770    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.819820 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819796    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.820429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.819879    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.820429 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.820078    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.820632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.820614    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.822700 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.822676    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.822898 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.822881    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.880313 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.880284    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.880518 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.880495    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csfvd\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\") pod \"e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") " pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:27.894392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:27.894369    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:28.337952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.337906    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:50:28.338739 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:50:28.338712    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d9266f_52e5_4f1f_8815_0697c67578bf.slice/crio-3abfa98eddf9cf5c890c1585d81a96277869f749329591f6530d9596b5384e7f WatchSource:0}: Error finding container 3abfa98eddf9cf5c890c1585d81a96277869f749329591f6530d9596b5384e7f: Status 404 returned error can't find the container with id 3abfa98eddf9cf5c890c1585d81a96277869f749329591f6530d9596b5384e7f
Oct 30 20:50:28.341184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.341152    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.341288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.341216    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.341288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.341251    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.594266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.594180    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" event={"ID":"e4d9266f-52e5-4f1f-8815-0697c67578bf","Type":"ContainerStarted","Data":"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"}
Oct 30 20:50:28.594266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.594244    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" event={"ID":"e4d9266f-52e5-4f1f-8815-0697c67578bf","Type":"ContainerStarted","Data":"3abfa98eddf9cf5c890c1585d81a96277869f749329591f6530d9596b5384e7f"}
Oct 30 20:50:28.595911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.595889    5446 generic.go:356] "Generic (PLEG): container finished" podID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerID="2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb" exitCode=0
Oct 30 20:50:28.596068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.595976    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerDied","Data":"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"}
Oct 30 20:50:28.596381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.596365    5446 scope.go:122] "RemoveContainer" containerID="2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"
Oct 30 20:50:28.597821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.597793    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.597948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.597877    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.598018 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.597975    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:28.724796 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.724736    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podStartSLOduration=1.724714938 podStartE2EDuration="1.724714938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:28.716536041 +0000 UTC m=+1394.708539169" watchObservedRunningTime="2026-10-30 20:50:28.724714938 +0000 UTC m=+1394.716718066"
Oct 30 20:50:28.894778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:28.894740    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:29.662949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:29.662891    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerStarted","Data":"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"}
Oct 30 20:50:29.926035 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:29.925129    5446 patch_prober.go:29] interesting pod/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:50:29.926035 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:29.925235    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Oct 30 20:50:30.344580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:30.344488    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:50:30.345328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:30.344847    5446 patch_prober.go:29] interesting pod/e2e-ait-f9782c31-openshift-default-84f68d447-647nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Oct 30 20:50:30.345524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:30.345498    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Oct 30 20:50:30.896942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:30.896269    5446 patch_prober.go:29] interesting pod/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:50:30.896942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:30.896343    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Oct 30 20:50:31.315998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:31.315324    5446 patch_prober.go:29] interesting pod/e2e-ait-f9782c31-openshift-default-84f68d447-647nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Oct 30 20:50:31.315998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:31.315390    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Oct 30 20:50:31.897338 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:31.897300    5446 patch_prober.go:29] interesting pod/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:50:31.897954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:31.897900    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Oct 30 20:50:32.322002 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:32.321605    5446 patch_prober.go:29] interesting pod/e2e-ait-f9782c31-openshift-default-84f68d447-647nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Oct 30 20:50:32.322002 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:32.321663    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Oct 30 20:50:32.896942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:32.896281    5446 patch_prober.go:29] interesting pod/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:50:32.896942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:32.896343    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Oct 30 20:50:33.321995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:33.321535    5446 patch_prober.go:29] interesting pod/e2e-ait-f9782c31-openshift-default-84f68d447-647nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Oct 30 20:50:33.321995 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:33.321612    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Oct 30 20:50:33.622034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:33.622002    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:50:33.910113 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:33.910025    5446 patch_prober.go:29] interesting pod/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Oct 30 20:50:33.910364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:33.910337    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Oct 30 20:50:34.314897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:34.314809    5446 patch_prober.go:29] interesting pod/e2e-ait-f9782c31-openshift-default-84f68d447-647nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Oct 30 20:50:34.315190 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:34.315162    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Oct 30 20:50:34.917134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:34.917100    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:34.917523 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:34.917486    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:34.918377 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:34.918358    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:50:35.318817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:35.318744    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:50:35.319813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:35.319796    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:50:45.003589 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:45.003555    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:50:49.525075 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:50:49.525035    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:50:50.004633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.004575    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" podUID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" containerName="payload-pre-processing" containerID="cri-o://fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3" gracePeriod=25
Oct 30 20:50:50.292737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.292714    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:50:50.406654 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.406606    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\") pod \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") "
Oct 30 20:50:50.406945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.406903    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\" (UniqueName: \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\") pod \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\" (UID: \"6c59e125-dbac-46a0-a5d1-f04dd4248b77\") "
Oct 30 20:50:50.408663 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.408638    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume" pod "6c59e125-dbac-46a0-a5d1-f04dd4248b77" (UID: "6c59e125-dbac-46a0-a5d1-f04dd4248b77"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:50:50.445713 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.445673    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7" pod "6c59e125-dbac-46a0-a5d1-f04dd4248b77" (UID: "6c59e125-dbac-46a0-a5d1-f04dd4248b77"). InnerVolumeSpecName "kube-api-access-nz7n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:50:50.509352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.509320    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c59e125-dbac-46a0-a5d1-f04dd4248b77-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:50:50.509599 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.509580    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz7n7\" (UniqueName: \"kubernetes.io/projected/6c59e125-dbac-46a0-a5d1-f04dd4248b77-kube-api-access-nz7n7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:50:50.854181 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.854142    5446 generic.go:356] "Generic (PLEG): container finished" podID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" containerID="fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3" exitCode=0
Oct 30 20:50:50.854704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.854211    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"
Oct 30 20:50:50.854704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.854224    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" event={"ID":"6c59e125-dbac-46a0-a5d1-f04dd4248b77","Type":"ContainerDied","Data":"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"}
Oct 30 20:50:50.854704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.854319    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr" event={"ID":"6c59e125-dbac-46a0-a5d1-f04dd4248b77","Type":"ContainerDied","Data":"0c3f7a4896faf626e5933806841a7bdff72de9c79a664e659daf59b990af0bdc"}
Oct 30 20:50:50.854704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.854350    5446 scope.go:122] "RemoveContainer" containerID="fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"
Oct 30 20:50:50.870098 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.870046    5446 scope.go:122] "RemoveContainer" containerID="fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"
Oct 30 20:50:50.870330 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:50:50.870302    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3\": container with ID starting with fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3 not found: ID does not exist" containerID="fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"
Oct 30 20:50:50.870439 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:50.870337    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3"} err="failed to get container status \"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3\": rpc error: code = NotFound desc = could not find container \"fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3\": container with ID starting with fb007c0364a601690758221677e74518721b0250ed4b38069ad5f494a6168fd3 not found: ID does not exist"
Oct 30 20:50:51.024659 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:51.024624    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:50:51.073075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:51.073045    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dc0e9f64-7b76b45f9-d66xr"]
Oct 30 20:50:52.121475 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:52.121446    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" path="/var/lib/kubelet/pods/6c59e125-dbac-46a0-a5d1-f04dd4248b77/volumes"
Oct 30 20:50:55.418228 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:55.418189    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:50:55.528397 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:50:55.528364    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:51:00.418989 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.418949    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" podUID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" containerName="payload-processing" containerID="cri-o://5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b" gracePeriod=25
Oct 30 20:51:00.529243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.529213    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" podUID="95f2b9f6-81f6-4c8f-a940-306543ccacae" containerName="payload-pre-processing" containerID="cri-o://86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa" gracePeriod=25
Oct 30 20:51:00.714320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.714291    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:51:00.849627 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.849603    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:51:00.856628 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.856605    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\") pod \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") "
Oct 30 20:51:00.856770 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.856654    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\" (UniqueName: \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\") pod \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\" (UID: \"50dc5c7e-e282-442a-ae87-08d73ba8bc64\") "
Oct 30 20:51:00.857095 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.857066    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume" pod "50dc5c7e-e282-442a-ae87-08d73ba8bc64" (UID: "50dc5c7e-e282-442a-ae87-08d73ba8bc64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:00.857431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.857410    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50dc5c7e-e282-442a-ae87-08d73ba8bc64-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:00.859078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.859049    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7" pod "50dc5c7e-e282-442a-ae87-08d73ba8bc64" (UID: "50dc5c7e-e282-442a-ae87-08d73ba8bc64"). InnerVolumeSpecName "kube-api-access-gkkk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:00.936662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.936595    5446 generic.go:356] "Generic (PLEG): container finished" podID="95f2b9f6-81f6-4c8f-a940-306543ccacae" containerID="86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa" exitCode=0
Oct 30 20:51:00.936662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.936644    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"
Oct 30 20:51:00.936817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.936685    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" event={"ID":"95f2b9f6-81f6-4c8f-a940-306543ccacae","Type":"ContainerDied","Data":"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"}
Oct 30 20:51:00.936817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.936740    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd" event={"ID":"95f2b9f6-81f6-4c8f-a940-306543ccacae","Type":"ContainerDied","Data":"132507b2f8e1cede3d09b384bf35323f6a8fc86cdd9ad9aa39e60b61fe6be4a9"}
Oct 30 20:51:00.936817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.936769    5446 scope.go:122] "RemoveContainer" containerID="86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"
Oct 30 20:51:00.938273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.938249    5446 generic.go:356] "Generic (PLEG): container finished" podID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" containerID="5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b" exitCode=0
Oct 30 20:51:00.938380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.938298    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" event={"ID":"50dc5c7e-e282-442a-ae87-08d73ba8bc64","Type":"ContainerDied","Data":"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"}
Oct 30 20:51:00.938380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.938340    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7" event={"ID":"50dc5c7e-e282-442a-ae87-08d73ba8bc64","Type":"ContainerDied","Data":"2a9ebbd83bbde66c90937a61e982a67a4099f9a641a43774cc255238acdae286"}
Oct 30 20:51:00.938380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.938303    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"
Oct 30 20:51:00.952081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.952066    5446 scope.go:122] "RemoveContainer" containerID="86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"
Oct 30 20:51:00.952361 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:00.952339    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa\": container with ID starting with 86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa not found: ID does not exist" containerID="86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"
Oct 30 20:51:00.952443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.952367    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa"} err="failed to get container status \"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa\": rpc error: code = NotFound desc = could not find container \"86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa\": container with ID starting with 86917ad10bb67316a9b126241a9e13cc8f51d0f346ce94eb4034fdd6f95529aa not found: ID does not exist"
Oct 30 20:51:00.952443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.952384    5446 scope.go:122] "RemoveContainer" containerID="5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"
Oct 30 20:51:00.958825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.958805    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\") pod \"95f2b9f6-81f6-4c8f-a940-306543ccacae\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") "
Oct 30 20:51:00.959016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.959002    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\" (UniqueName: \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\") pod \"95f2b9f6-81f6-4c8f-a940-306543ccacae\" (UID: \"95f2b9f6-81f6-4c8f-a940-306543ccacae\") "
Oct 30 20:51:00.959242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.959219    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume" pod "95f2b9f6-81f6-4c8f-a940-306543ccacae" (UID: "95f2b9f6-81f6-4c8f-a940-306543ccacae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:00.959568 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.959551    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95f2b9f6-81f6-4c8f-a940-306543ccacae-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:00.959607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.959576    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkkk7\" (UniqueName: \"kubernetes.io/projected/50dc5c7e-e282-442a-ae87-08d73ba8bc64-kube-api-access-gkkk7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:00.961304 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.961284    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr" pod "95f2b9f6-81f6-4c8f-a940-306543ccacae" (UID: "95f2b9f6-81f6-4c8f-a940-306543ccacae"). InnerVolumeSpecName "kube-api-access-h6zxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:00.962493 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.962472    5446 scope.go:122] "RemoveContainer" containerID="5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"
Oct 30 20:51:00.962728 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:00.962707    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b\": container with ID starting with 5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b not found: ID does not exist" containerID="5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"
Oct 30 20:51:00.962789 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:00.962731    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b"} err="failed to get container status \"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b\": rpc error: code = NotFound desc = could not find container \"5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b\": container with ID starting with 5cdf693ff0b68f3650030f0d46ee0b585114c9a362e1a55cf24c0ed8a4957a4b not found: ID does not exist"
Oct 30 20:51:01.060780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:01.060749    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6zxr\" (UniqueName: \"kubernetes.io/projected/95f2b9f6-81f6-4c8f-a940-306543ccacae-kube-api-access-h6zxr\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:01.090232 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:01.090192    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:51:01.097176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:01.097127    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9782c31-797cdf9cbd-hk2h7"]
Oct 30 20:51:01.365691 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:01.365652    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:51:01.373257 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:01.373229    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9782c31-57894dff4c-tstbd"]
Oct 30 20:51:02.122606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:02.122572    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" path="/var/lib/kubelet/pods/50dc5c7e-e282-442a-ae87-08d73ba8bc64/volumes"
Oct 30 20:51:02.123199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:02.123067    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95f2b9f6-81f6-4c8f-a940-306543ccacae" path="/var/lib/kubelet/pods/95f2b9f6-81f6-4c8f-a940-306543ccacae/volumes"
Oct 30 20:51:06.130546 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.130515    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:51:06.131261 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131241    5446 cpu_manager.go:414] "containerMap: removing container" podUID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" containerName="payload-pre-processing"
Oct 30 20:51:06.131371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131265    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" containerName="payload-pre-processing"
Oct 30 20:51:06.131371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131277    5446 cpu_manager.go:414] "containerMap: removing container" podUID="95f2b9f6-81f6-4c8f-a940-306543ccacae" containerName="payload-pre-processing"
Oct 30 20:51:06.131371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131285    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95f2b9f6-81f6-4c8f-a940-306543ccacae" containerName="payload-pre-processing"
Oct 30 20:51:06.131371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131351    5446 cpu_manager.go:414] "containerMap: removing container" podUID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" containerName="payload-processing"
Oct 30 20:51:06.131371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131358    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" containerName="payload-processing"
Oct 30 20:51:06.131562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131509    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="50dc5c7e-e282-442a-ae87-08d73ba8bc64" containerName="payload-processing"
Oct 30 20:51:06.131562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131528    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c59e125-dbac-46a0-a5d1-f04dd4248b77" containerName="payload-pre-processing"
Oct 30 20:51:06.131562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.131534    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="95f2b9f6-81f6-4c8f-a940-306543ccacae" containerName="payload-pre-processing"
Oct 30 20:51:06.134540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.134520    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.187027 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.187005    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hsn45\""
Oct 30 20:51:06.242148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.242115    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:51:06.262136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262106    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262159    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262255    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262372    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262507    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262583 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262572    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfz6z\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262608    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262627    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.262745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.262712    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.363746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.363719    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.363899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.363757    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.363899 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.363786    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.363955    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364101 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364084    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364103    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364165    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364175    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfz6z\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364205    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364226    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364295    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364563    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364652    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.364845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.364704    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.366569 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.366549    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.366693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.366673    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.423732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.423668    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.423817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.423772    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfz6z\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\") pod \"maas-default-gateway-openshift-default-58847f9fc5-vhkcv\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.447265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.447243    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:06.916852 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.916817    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:51:06.917457 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:51:06.917431    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79f53f9_11f1_46eb_8b6d_12df0337f833.slice/crio-8c88075ecd79d0a9f6286c9b6914ca416229b052a3658235587f3e4f1d2b07da WatchSource:0}: Error finding container 8c88075ecd79d0a9f6286c9b6914ca416229b052a3658235587f3e4f1d2b07da: Status 404 returned error can't find the container with id 8c88075ecd79d0a9f6286c9b6914ca416229b052a3658235587f3e4f1d2b07da
Oct 30 20:51:06.920280 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.920244    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:06.920352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.920312    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:06.920352 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:06.920342    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:07.077978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.076578    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" event={"ID":"a79f53f9-11f1-46eb-8b6d-12df0337f833","Type":"ContainerStarted","Data":"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"}
Oct 30 20:51:07.077978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.076646    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" event={"ID":"a79f53f9-11f1-46eb-8b6d-12df0337f833","Type":"ContainerStarted","Data":"8c88075ecd79d0a9f6286c9b6914ca416229b052a3658235587f3e4f1d2b07da"}
Oct 30 20:51:07.197907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.197774    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podStartSLOduration=1.197760907 podStartE2EDuration="1.197760907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:07.19542651 +0000 UTC m=+1433.187429639" watchObservedRunningTime="2026-10-30 20:51:07.197760907 +0000 UTC m=+1433.189764033"
Oct 30 20:51:07.448012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.447933    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:07.449150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.449128    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:07.449223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:07.449180    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:08.447561 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:08.447528    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:08.448120 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:08.447585    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:09.448016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:09.447979    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:09.448406 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:09.448062    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:10.448132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:10.448098    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:10.448525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:10.448158    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:11.448512 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:11.448475    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:11.449043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:11.448536    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:12.448149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:12.448111    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:12.448330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:12.448172    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:13.448453 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:13.448417    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:13.448976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:13.448477    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:14.447607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:14.447578    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-vhkcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Oct 30 20:51:14.447736 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:14.447637    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Oct 30 20:51:15.452638 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:15.452600    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:15.453193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:15.453024    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:15.453668 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:15.453644    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:51:19.517109 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:19.517062    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:51:21.239474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.239442    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:51:21.245599 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.245578    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338065    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338202 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338096    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338202 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338131    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxdnk\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338239    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338280    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338304    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338490 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338463    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338529    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.338600 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.338578    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.351782 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.351752    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:51:21.439850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.439826    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.439856    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.439885    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxdnk\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.439953    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440004    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440042    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440164    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440252    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440280    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440401    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440459    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440578 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440550    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440554    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.440732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.440714    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.442848 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.442825    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.443003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.442986    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.500591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.500534    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.500682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.500663    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxdnk\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\") pod \"maas-default-gateway-openshift-default-58847f9fc5-w8r7l\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.560970 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.560945    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:21.995676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.995652    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:51:21.997329 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:51:21.997300    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f3ae25_a30c_4269_8ba3_a10640b99f49.slice/crio-dd4ea97650f11749dbfa82ab7cb34adbda7961c7e3cb360dfd42149c1148d5dd WatchSource:0}: Error finding container dd4ea97650f11749dbfa82ab7cb34adbda7961c7e3cb360dfd42149c1148d5dd: Status 404 returned error can't find the container with id dd4ea97650f11749dbfa82ab7cb34adbda7961c7e3cb360dfd42149c1148d5dd
Oct 30 20:51:21.999769 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.999738    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:21.999828 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.999803    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:21.999870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:21.999829    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:51:22.204719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:22.204633    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" event={"ID":"88f3ae25-a30c-4269-8ba3-a10640b99f49","Type":"ContainerStarted","Data":"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"}
Oct 30 20:51:22.204719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:22.204684    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" event={"ID":"88f3ae25-a30c-4269-8ba3-a10640b99f49","Type":"ContainerStarted","Data":"dd4ea97650f11749dbfa82ab7cb34adbda7961c7e3cb360dfd42149c1148d5dd"}
Oct 30 20:51:22.327624 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:22.327502    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podStartSLOduration=1.327488292 podStartE2EDuration="1.327488292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:22.325884022 +0000 UTC m=+1448.317887152" watchObservedRunningTime="2026-10-30 20:51:22.327488292 +0000 UTC m=+1448.319491493"
Oct 30 20:51:22.561944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:22.561903    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:23.563513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:23.563482    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:23.563929 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:23.563536    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:24.561246 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:24.561215    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:24.561427 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:24.561290    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:25.562121 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:25.562092    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:25.562529 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:25.562150    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:26.561677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:26.561645    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:26.561852 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:26.561706    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:27.563003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:27.562972    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:27.563394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:27.563023    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:28.381952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:28.381885    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:51:28.382185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:28.382159    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy" containerID="cri-o://9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00" gracePeriod=30
Oct 30 20:51:28.561843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:28.561811    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:28.562203 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:28.562160    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:29.561402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:29.561371    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-w8r7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Oct 30 20:51:29.561823 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:29.561427    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Oct 30 20:51:30.659128 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:30.659091    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:30.659611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:30.659472    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:30.660400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:30.660379    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:51:33.700426 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.700402    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:51:33.764160 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764137    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764188    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764217    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764317    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764412    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:33.764535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764521    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764559    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764502    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:33.764598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764578    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:33.764760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764602    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764670    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764680    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:33.764760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764719    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\") pod \"bcabfdac-bf51-4642-92c3-c88883c759a0\" (UID: \"bcabfdac-bf51-4642-92c3-c88883c759a0\") "
Oct 30 20:51:33.764993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.764960    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:33.765767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.765742    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.765907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.765771    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.765907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.765788    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.765907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.765803    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.765907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.765817    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcabfdac-bf51-4642-92c3-c88883c759a0-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.767030 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.767004    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:33.767151 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.767099    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:51:33.767303 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.767275    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:33.767395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.767303    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6" pod "bcabfdac-bf51-4642-92c3-c88883c759a0" (UID: "bcabfdac-bf51-4642-92c3-c88883c759a0"). InnerVolumeSpecName "kube-api-access-n78x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:33.867277 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.867253    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.867277 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.867277    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.867407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.867286    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcabfdac-bf51-4642-92c3-c88883c759a0-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:33.867407 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:33.867297    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n78x6\" (UniqueName: \"kubernetes.io/projected/bcabfdac-bf51-4642-92c3-c88883c759a0-kube-api-access-n78x6\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:34.333466 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.333428    5446 generic.go:356] "Generic (PLEG): container finished" podID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerID="9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00" exitCode=0
Oct 30 20:51:34.333966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.333937    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerDied","Data":"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"}
Oct 30 20:51:34.334227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.334207    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk" event={"ID":"bcabfdac-bf51-4642-92c3-c88883c759a0","Type":"ContainerDied","Data":"8294b6fc856cd8567e6e0d415a7fee10f1ee46986b82d94e807d01ddd9ce7e70"}
Oct 30 20:51:34.334414 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.334400    5446 scope.go:122] "RemoveContainer" containerID="9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"
Oct 30 20:51:34.334762 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.334747    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"
Oct 30 20:51:34.375253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.375221    5446 scope.go:122] "RemoveContainer" containerID="3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"
Oct 30 20:51:34.386022 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.385993    5446 scope.go:122] "RemoveContainer" containerID="9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"
Oct 30 20:51:34.386360 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:34.386331    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00\": container with ID starting with 9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00 not found: ID does not exist" containerID="9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"
Oct 30 20:51:34.386449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.386366    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00"} err="failed to get container status \"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00\": rpc error: code = NotFound desc = could not find container \"9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00\": container with ID starting with 9aa7b7a1cf1c480a5ceab969e7ba4cdf46a80b925ef85381f2933ff6d4c4cc00 not found: ID does not exist"
Oct 30 20:51:34.386449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.386391    5446 scope.go:122] "RemoveContainer" containerID="3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"
Oct 30 20:51:34.386737 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:34.386715    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9\": container with ID starting with 3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9 not found: ID does not exist" containerID="3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"
Oct 30 20:51:34.386800 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.386745    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9"} err="failed to get container status \"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9\": rpc error: code = NotFound desc = could not find container \"3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9\": container with ID starting with 3369f95191d6a082d6644e376e89997a599366082769ad0196225fc4444aa4d9 not found: ID does not exist"
Oct 30 20:51:34.506643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.506606    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:51:34.556717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:34.556682    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dc0e9f64-gw-openshift-default-78c7d6c5df-dr4pk"]
Oct 30 20:51:35.567937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:35.548130    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:51:35.567937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:35.548367    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy" containerID="cri-o://921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457" gracePeriod=30
Oct 30 20:51:36.125000 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:36.124970    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" path="/var/lib/kubelet/pods/bcabfdac-bf51-4642-92c3-c88883c759a0/volumes"
Oct 30 20:51:38.833613 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:38.833584    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:51:38.834017 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:38.833796    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy" containerID="cri-o://aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf" gracePeriod=30
Oct 30 20:51:40.803169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.803145    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:51:40.947077 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947051    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947198 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947150    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947246    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947267    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947300    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947393 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947328    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947432    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947463    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:40.947513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947497    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947510    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:40.947625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947541    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:40.947625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947571    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:40.947625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947604    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\") pod \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\" (UID: \"35cfc5f2-6f66-4880-8d4e-6a40eed6c094\") "
Oct 30 20:51:40.947856 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.947827    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:40.948704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.948676    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:40.948814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.948706    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:40.948814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.948720    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:40.948814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.948734    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:40.948814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.948750    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:40.949716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.949688    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:40.949716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.949701    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:51:40.949894 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.949772    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:40.949894 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:40.949881    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh" pod "35cfc5f2-6f66-4880-8d4e-6a40eed6c094" (UID: "35cfc5f2-6f66-4880-8d4e-6a40eed6c094"). InnerVolumeSpecName "kube-api-access-zh5vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:41.051129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.051096    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:41.051129 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.051132    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh5vh\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-kube-api-access-zh5vh\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:41.051312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.051148    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:41.051312 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.051162    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35cfc5f2-6f66-4880-8d4e-6a40eed6c094-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:41.439172 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.439120    5446 generic.go:356] "Generic (PLEG): container finished" podID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerID="921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457" exitCode=0
Oct 30 20:51:41.439172 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.439167    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerDied","Data":"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"}
Oct 30 20:51:41.439409 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.439222    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj" event={"ID":"35cfc5f2-6f66-4880-8d4e-6a40eed6c094","Type":"ContainerDied","Data":"8052f6cd20d0aed300c6b0e109cf49d999f46a6ede329d9e4d9bf07567cf0c1e"}
Oct 30 20:51:41.439409 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.439175    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"
Oct 30 20:51:41.439409 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.439251    5446 scope.go:122] "RemoveContainer" containerID="921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"
Oct 30 20:51:41.450661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.450643    5446 scope.go:122] "RemoveContainer" containerID="2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"
Oct 30 20:51:41.460083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.460065    5446 scope.go:122] "RemoveContainer" containerID="921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"
Oct 30 20:51:41.460372 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:41.460353    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457\": container with ID starting with 921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457 not found: ID does not exist" containerID="921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"
Oct 30 20:51:41.460417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.460380    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457"} err="failed to get container status \"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457\": rpc error: code = NotFound desc = could not find container \"921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457\": container with ID starting with 921eb5b232282acf1471241df0bfda7801ebb864422cbc8b6b573c319b19d457 not found: ID does not exist"
Oct 30 20:51:41.460417 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.460398    5446 scope.go:122] "RemoveContainer" containerID="2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"
Oct 30 20:51:41.460646 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:41.460629    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb\": container with ID starting with 2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb not found: ID does not exist" containerID="2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"
Oct 30 20:51:41.460692 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.460651    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb"} err="failed to get container status \"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb\": rpc error: code = NotFound desc = could not find container \"2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb\": container with ID starting with 2beefae3b2e500c94b6d24892de9f47e915893344e0b881cc4104d542986e4eb not found: ID does not exist"
Oct 30 20:51:41.612488 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.612459    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:51:41.616080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:41.616056    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f9782c31-openshift-default-84f68d447-647nj"]
Oct 30 20:51:42.123176 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:42.123147    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" path="/var/lib/kubelet/pods/35cfc5f2-6f66-4880-8d4e-6a40eed6c094/volumes"
Oct 30 20:51:44.128388 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.128359    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:51:44.300651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300617    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.300809 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300704    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.300809 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300745    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.300809 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300799    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300830    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300878    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:44.301040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.300972    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301004    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301076    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301185    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\") pod \"e4d9266f-52e5-4f1f-8815-0697c67578bf\" (UID: \"e4d9266f-52e5-4f1f-8815-0697c67578bf\") "
Oct 30 20:51:44.301252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301202    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:44.301404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301360    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:44.301459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301392    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:44.301577 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301555    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:44.301968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301900    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.301968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301957    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.302154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301971    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.302154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301986    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4d9266f-52e5-4f1f-8815-0697c67578bf-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.302154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.301998    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.304127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.304103    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "kube-api-access-csfvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:44.304244 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.304130    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:44.304366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.304344    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:51:44.304965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.304907    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy" pod "e4d9266f-52e5-4f1f-8815-0697c67578bf" (UID: "e4d9266f-52e5-4f1f-8815-0697c67578bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:44.403676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.403634    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.403676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.403665    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csfvd\" (UniqueName: \"kubernetes.io/projected/e4d9266f-52e5-4f1f-8815-0697c67578bf-kube-api-access-csfvd\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.403676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.403676    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.403676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.403685    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4d9266f-52e5-4f1f-8815-0697c67578bf-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:44.463412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.463373    5446 generic.go:356] "Generic (PLEG): container finished" podID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerID="aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf" exitCode=0
Oct 30 20:51:44.463580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.463469    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"
Oct 30 20:51:44.463580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.463487    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" event={"ID":"e4d9266f-52e5-4f1f-8815-0697c67578bf","Type":"ContainerDied","Data":"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"}
Oct 30 20:51:44.463580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.463542    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr" event={"ID":"e4d9266f-52e5-4f1f-8815-0697c67578bf","Type":"ContainerDied","Data":"3abfa98eddf9cf5c890c1585d81a96277869f749329591f6530d9596b5384e7f"}
Oct 30 20:51:44.463580 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.463567    5446 scope.go:122] "RemoveContainer" containerID="aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"
Oct 30 20:51:44.475610 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.475590    5446 scope.go:122] "RemoveContainer" containerID="aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"
Oct 30 20:51:44.475906 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:44.475887    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf\": container with ID starting with aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf not found: ID does not exist" containerID="aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"
Oct 30 20:51:44.475983 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.475930    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf"} err="failed to get container status \"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf\": rpc error: code = NotFound desc = could not find container \"aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf\": container with ID starting with aa47f27d0996e5516dd316b52a0e6dfe0a6bc1dc74b20af9a3e027397f0759cf not found: ID does not exist"
Oct 30 20:51:44.636398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.636370    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:51:44.643348 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:44.643323    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-78ca07a3-openshift-default-74c99c977c-lx7cr"]
Oct 30 20:51:46.122197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:51:46.122159    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" path="/var/lib/kubelet/pods/e4d9266f-52e5-4f1f-8815-0697c67578bf/volumes"
Oct 30 20:51:49.521891 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:51:49.521854    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:52:10.194521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.194465    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.202118    5446 cpu_manager.go:414] "containerMap: removing container" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211633    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211716    5446 cpu_manager.go:414] "containerMap: removing container" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211727    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211757    5446 cpu_manager.go:414] "containerMap: removing container" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211765    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211799    5446 cpu_manager.go:414] "containerMap: removing container" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211806    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211828    5446 cpu_manager.go:414] "containerMap: removing container" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.211836    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.212204    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.212226    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.212236    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4d9266f-52e5-4f1f-8815-0697c67578bf" containerName="istio-proxy"
Oct 30 20:52:10.212961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.212255    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="35cfc5f2-6f66-4880-8d4e-6a40eed6c094" containerName="istio-proxy"
Oct 30 20:52:10.216773 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.216753    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.249651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.249576    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:52:10.292598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.292569    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w5-0702ff\""
Oct 30 20:52:10.292598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.292569    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w5-0702ff-dockercfg-f9c7g\""
Oct 30 20:52:10.310029 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.310000    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.310190 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.310174    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsck\" (UniqueName: \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.357682 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.357649    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:52:10.358474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.358458    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcabfdac-bf51-4642-92c3-c88883c759a0" containerName="istio-proxy"
Oct 30 20:52:10.361817 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.361797    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.411734 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.411692    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.412059 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.412021    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.412177 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.412163    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v489r\" (UniqueName: \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.412249 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.412199    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsck\" (UniqueName: \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.413253 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.413227    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.436939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.424290    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:52:10.511991 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.511095    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsck\" (UniqueName: \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\") pod \"payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.514282 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.514248    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v489r\" (UniqueName: \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.514436 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.514350    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.515477 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.515271    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.537496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.537463    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:10.586985 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.583632    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v489r\" (UniqueName: \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\") pod \"payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.678350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.678319    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:10.998689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:10.998660    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:52:10.999822 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:52:10.999798    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0122e012_b737_4de4_bc2d_5d788f033f8d.slice/crio-db18a578a1693eb3483c665b187b706388ec49f26eb0ebbe3bd62db33e32e11d WatchSource:0}: Error finding container db18a578a1693eb3483c665b187b706388ec49f26eb0ebbe3bd62db33e32e11d: Status 404 returned error can't find the container with id db18a578a1693eb3483c665b187b706388ec49f26eb0ebbe3bd62db33e32e11d
Oct 30 20:52:11.100538 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.100511    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:52:11.101327 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:52:11.101305    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c05be7_1cb3_4a93_8e1c_8ae67d049e1d.slice/crio-e7d05d66c5f288a1205db8259cefa6e3a4e13c453e4902cc19a8f0e916259aaa WatchSource:0}: Error finding container e7d05d66c5f288a1205db8259cefa6e3a4e13c453e4902cc19a8f0e916259aaa: Status 404 returned error can't find the container with id e7d05d66c5f288a1205db8259cefa6e3a4e13c453e4902cc19a8f0e916259aaa
Oct 30 20:52:11.737389 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.737349    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" event={"ID":"0122e012-b737-4de4-bc2d-5d788f033f8d","Type":"ContainerStarted","Data":"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"}
Oct 30 20:52:11.737862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.737418    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" event={"ID":"0122e012-b737-4de4-bc2d-5d788f033f8d","Type":"ContainerStarted","Data":"db18a578a1693eb3483c665b187b706388ec49f26eb0ebbe3bd62db33e32e11d"}
Oct 30 20:52:11.737862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.737552    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:11.739070 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.739048    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" event={"ID":"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d","Type":"ContainerStarted","Data":"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"}
Oct 30 20:52:11.739194 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.739090    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" event={"ID":"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d","Type":"ContainerStarted","Data":"e7d05d66c5f288a1205db8259cefa6e3a4e13c453e4902cc19a8f0e916259aaa"}
Oct 30 20:52:11.739194 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.739119    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:11.864668 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.864621    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" podStartSLOduration=1.864605841 podStartE2EDuration="1.864605841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:11.861882591 +0000 UTC m=+1497.853885718" watchObservedRunningTime="2026-10-30 20:52:11.864605841 +0000 UTC m=+1497.856608967"
Oct 30 20:52:11.994986 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:11.994880    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" podStartSLOduration=1.994864534 podStartE2EDuration="1.994864534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:11.989878875 +0000 UTC m=+1497.981882003" watchObservedRunningTime="2026-10-30 20:52:11.994864534 +0000 UTC m=+1497.986867661"
Oct 30 20:52:19.517202 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:52:19.517166    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:52:22.749441 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:22.749413    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:52:22.749903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:22.749478    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:52:33.001473 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.001440    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:52:33.005692 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.005674    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.042051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.042030    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.042153 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.042059    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwj2\" (UniqueName: \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.042298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.042274    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.042392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.042369    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.108727 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.108696    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ad0ff4fc-serving-cert\""
Oct 30 20:52:33.112526 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.112505    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:52:33.143489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.143460    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.143618 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:52:33.143585    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-serving-cert: secret "maas-api-e2e-ait-ad0ff4fc-serving-cert" not found
Oct 30 20:52:33.143681 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:52:33.143653    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls podName:b1df9727-0c12-4c88-a238-ed274236a9ef nodeName:}" failed. No retries permitted until 2026-10-30 20:52:33.643633959 +0000 UTC m=+1519.635637069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls") pod "maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" (UID: "b1df9727-0c12-4c88-a238-ed274236a9ef") : secret "maas-api-e2e-ait-ad0ff4fc-serving-cert" not found
Oct 30 20:52:33.143753 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.143676    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.143753 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.143709    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwj2\" (UniqueName: \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.143962 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.143938    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.144675 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.144651    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.146786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.146764    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.204427 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.204398    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwj2\" (UniqueName: \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.651294 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.651262    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.653769 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.653747    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") pod \"maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:33.919677 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:33.919596    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:34.302184 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:52:34.302159    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1df9727_0c12_4c88_a238_ed274236a9ef.slice/crio-1fe8d6961d15dc603a5bfb6a68c8a413681d2cf7d1595742f48751fee96e9631 WatchSource:0}: Error finding container 1fe8d6961d15dc603a5bfb6a68c8a413681d2cf7d1595742f48751fee96e9631: Status 404 returned error can't find the container with id 1fe8d6961d15dc603a5bfb6a68c8a413681d2cf7d1595742f48751fee96e9631
Oct 30 20:52:34.302968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:34.302939    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:52:34.901719 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:34.901686    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" event={"ID":"b1df9727-0c12-4c88-a238-ed274236a9ef","Type":"ContainerStarted","Data":"1fe8d6961d15dc603a5bfb6a68c8a413681d2cf7d1595742f48751fee96e9631"}
Oct 30 20:52:35.910041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:35.910004    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" event={"ID":"b1df9727-0c12-4c88-a238-ed274236a9ef","Type":"ContainerStarted","Data":"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"}
Oct 30 20:52:35.910436 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:35.910155    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:36.028628 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:36.028573    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" podStartSLOduration=3.193860837 podStartE2EDuration="4.028558894s" totalImagesPullingTime="834.698057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:36.026598463 +0000 UTC m=+1522.018601590" watchObservedRunningTime="2026-10-30 20:52:36.028558894 +0000 UTC m=+1522.020562020"
Oct 30 20:52:41.922737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:41.922710    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:52:49.519809 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:52:49.519763    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:52:51.957244 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:51.957212    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:52:51.962687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:51.962669    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.006862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.006839    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"]
Oct 30 20:52:52.011413 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.011394    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.033203 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.033177    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ngv\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.033415 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.033391    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.033611 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.033592    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.033933 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.033777    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.034245 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.034225    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.034396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.034379    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.034543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.034526    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.034769 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.034749    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.035035 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.035016    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.143525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.143499    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"]
Oct 30 20:52:52.144544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.144519    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.144880 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.144826    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.145087 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.145071    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.145618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.145593    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.146044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.146028    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.148740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.148711    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.149251 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.149233    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.149665 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.149651    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.149910 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.149893    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.150131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.150115    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.150511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.150496    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.150693 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.150677    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.150875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.150860    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151333 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.145506    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151454 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.150437    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.149589    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151680 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.146780    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.145961    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.151854 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.151839    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.152016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.152001    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accdad77-bc95-4deb-8e45-2aecf980b1f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.152220 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.152205    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ngv\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.152566 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.152550    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.153047 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.153030    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qqw\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-kube-api-access-k6qqw\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.171156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.160402    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.171156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.170936    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.172286 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.172263    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257094    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257172    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257224    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257270    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257348    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accdad77-bc95-4deb-8e45-2aecf980b1f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257429    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qqw\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-kube-api-access-k6qqw\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257498    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257548    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.257692    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.259380    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.259538    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.260746 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.260100    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accdad77-bc95-4deb-8e45-2aecf980b1f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.262594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.261589    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.262594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.261592    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.262594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.261863    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.262758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.262591    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.264650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.264325    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ngv\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-twxfz\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.264650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.264605    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.276492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.276471    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:52.322016 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.321985    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qqw\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-kube-api-access-k6qqw\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.323978 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.323933    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accdad77-bc95-4deb-8e45-2aecf980b1f6-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-tcxrk\" (UID: \"accdad77-bc95-4deb-8e45-2aecf980b1f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.345948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.341179    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:52.760120 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:52:52.760078    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8e0e11_4248_4879_b6d3_9ed77222ef84.slice/crio-34d744a7389b491a3dddee3580ddbf94b5e90f8423d789e0f15e045587c3a302 WatchSource:0}: Error finding container 34d744a7389b491a3dddee3580ddbf94b5e90f8423d789e0f15e045587c3a302: Status 404 returned error can't find the container with id 34d744a7389b491a3dddee3580ddbf94b5e90f8423d789e0f15e045587c3a302
Oct 30 20:52:52.760489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.760469    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:52:52.762684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.762658    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:52.762767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.762713    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:52.762767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.762742    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:52.812678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.812654    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"]
Oct 30 20:52:52.817124 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.816521    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:52.817124 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.816603    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:52.817124 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:52.816650    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:53.053907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.053555    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" event={"ID":"accdad77-bc95-4deb-8e45-2aecf980b1f6","Type":"ContainerStarted","Data":"166db227ef176d3eed189416e09ce29f261e139e40b4910a53b030feaf87dece"}
Oct 30 20:52:53.053907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.053619    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" event={"ID":"accdad77-bc95-4deb-8e45-2aecf980b1f6","Type":"ContainerStarted","Data":"4fe6fdc118ecd82eb58614a74821518bf23fc6262594a1b833871a6bd062afee"}
Oct 30 20:52:53.057400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.056490    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" event={"ID":"8a8e0e11-4248-4879-b6d3-9ed77222ef84","Type":"ContainerStarted","Data":"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"}
Oct 30 20:52:53.057400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.056548    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" event={"ID":"8a8e0e11-4248-4879-b6d3-9ed77222ef84","Type":"ContainerStarted","Data":"34d744a7389b491a3dddee3580ddbf94b5e90f8423d789e0f15e045587c3a302"}
Oct 30 20:52:53.177404 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.177344    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podStartSLOduration=2.177326029 podStartE2EDuration="2.177326029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:53.172230859 +0000 UTC m=+1539.164233987" watchObservedRunningTime="2026-10-30 20:52:53.177326029 +0000 UTC m=+1539.169329159"
Oct 30 20:52:53.277161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.277127    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:52:53.278616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.278590    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:53.278760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.278656    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:53.297669 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.297616    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podStartSLOduration=2.297601854 podStartE2EDuration="2.297601854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:53.290486355 +0000 UTC m=+1539.282489479" watchObservedRunningTime="2026-10-30 20:52:53.297601854 +0000 UTC m=+1539.289604980"
Oct 30 20:52:53.348365 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.348280    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:52:53.349734 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.349708    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:53.349858 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:53.349762    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:54.278009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:54.277952    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:54.278469 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:54.278017    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:54.349089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:54.348973    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:54.349089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:54.349030    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:55.278369 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:55.277064    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:55.278369 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:55.277119    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:55.349309 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:55.349273    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:55.349489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:55.349330    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:56.277936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:56.277631    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:56.277936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:56.277687    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:56.348872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:56.348838    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:56.349251 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:56.348896    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:57.277089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:57.277054    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:57.277272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:57.277115    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:57.348473 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:57.348435    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:57.348654 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:57.348497    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:58.278650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:58.278614    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:58.279248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:58.279216    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:58.348279 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:58.348239    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:58.348463 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:58.348299    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:52:59.277218 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:59.277180    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:52:59.278672 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:59.278630    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:52:59.348210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:59.348180    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:52:59.348356 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:52:59.348219    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:53:00.277716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:00.277681    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-twxfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Oct 30 20:53:00.277952 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:00.277753    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Oct 30 20:53:00.348370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:00.348338    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Oct 30 20:53:00.348837 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:00.348395    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Oct 30 20:53:01.757826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.757790    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:53:01.758533 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.758508    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:53:01.760236 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.760203    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:53:01.776108 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.776074    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:53:01.777380 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.777357    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:53:01.778347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:01.778329    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk"
Oct 30 20:53:19.517566 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:19.517522    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:53:24.741028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.740995    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:53:24.746586 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.746563    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:24.802574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.802541    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:53:24.863415 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.861128    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0c83a089\""
Oct 30 20:53:24.863717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.863679    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0c83a089-dockercfg-shr4f\""
Oct 30 20:53:24.919544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.918848    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pkw\" (UniqueName: \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:24.919544 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:24.919177    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.016030 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.015947    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:53:25.026207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.026170    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.026772 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.026746    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pkw\" (UniqueName: \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.028331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.028308    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.043990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.043961    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:53:25.044511 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.044490    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.088370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.088336    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pkw\" (UniqueName: \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\") pod \"payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.128242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.128210    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.128432 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.128410    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8pmc\" (UniqueName: \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.229990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.229954    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8pmc\" (UniqueName: \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.230195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.230176    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.230826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.230810    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.288205 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.288135    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8pmc\" (UniqueName: \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\") pod \"payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") " pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.365364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.365331    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:25.368424 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.368396    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:25.750756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.750725    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:53:25.787882 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:53:25.787855    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2e98d9_d75c_4a93_ada5_d935c7e2274b.slice/crio-5bcd4be1dffa70ef2f93794d4b6f79e2246ece2a455c5dca5dcb23c2d7200fb6 WatchSource:0}: Error finding container 5bcd4be1dffa70ef2f93794d4b6f79e2246ece2a455c5dca5dcb23c2d7200fb6: Status 404 returned error can't find the container with id 5bcd4be1dffa70ef2f93794d4b6f79e2246ece2a455c5dca5dcb23c2d7200fb6
Oct 30 20:53:25.802306 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:25.802280    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:53:25.804026 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:53:25.803996    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3ebc52_6f4e_4cfe_aa56_a36da956811c.slice/crio-6a71f219053bb8c7b577912d28f1e7c35ec41da153e80bbcad58912da8c52818 WatchSource:0}: Error finding container 6a71f219053bb8c7b577912d28f1e7c35ec41da153e80bbcad58912da8c52818: Status 404 returned error can't find the container with id 6a71f219053bb8c7b577912d28f1e7c35ec41da153e80bbcad58912da8c52818
Oct 30 20:53:26.369966 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.369886    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" event={"ID":"7d2e98d9-d75c-4a93-ada5-d935c7e2274b","Type":"ContainerStarted","Data":"67080c18a27749c21d1424ab33fbf77143593ed3ac930b92ff1f68a5cadb20d6"}
Oct 30 20:53:26.370165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.369976    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" event={"ID":"7d2e98d9-d75c-4a93-ada5-d935c7e2274b","Type":"ContainerStarted","Data":"5bcd4be1dffa70ef2f93794d4b6f79e2246ece2a455c5dca5dcb23c2d7200fb6"}
Oct 30 20:53:26.370165 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.370004    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:26.371681 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.371659    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" event={"ID":"6a3ebc52-6f4e-4cfe-aa56-a36da956811c","Type":"ContainerStarted","Data":"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"}
Oct 30 20:53:26.371801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.371696    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" event={"ID":"6a3ebc52-6f4e-4cfe-aa56-a36da956811c","Type":"ContainerStarted","Data":"6a71f219053bb8c7b577912d28f1e7c35ec41da153e80bbcad58912da8c52818"}
Oct 30 20:53:26.371801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.371720    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:26.534331 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.534251    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" podStartSLOduration=2.534225474 podStartE2EDuration="2.534225474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:26.523399142 +0000 UTC m=+1572.515402295" watchObservedRunningTime="2026-10-30 20:53:26.534225474 +0000 UTC m=+1572.526228601"
Oct 30 20:53:26.642295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:26.642186    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" podStartSLOduration=2.6421715409999997 podStartE2EDuration="2.642171541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:26.637290082 +0000 UTC m=+1572.629293222" watchObservedRunningTime="2026-10-30 20:53:26.642171541 +0000 UTC m=+1572.634174669"
Oct 30 20:53:36.194939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.191871    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:53:36.225937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.219298    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267308    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267373    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267408    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267467    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267503    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwf7\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267638    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267674    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267712    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.271216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.267753    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.301948 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.293387    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:53:36.312942 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.309079    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-aaf669-openshift-default-dockercfg-rbxkr\""
Oct 30 20:53:36.374831 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.374705    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.379260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.379235    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.379456 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.379439    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.379676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.379661    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.438350    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.439251    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.439323    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.439364    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.439445    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.442941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.439492    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwf7\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.448951 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.448856    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.449392 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.449370    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.449777 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.449754    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.469937 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.453960    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.567132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.567097    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.639748 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.636936    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.684939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.675478    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.787109 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.787022    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwf7\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\") pod \"e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") " pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:36.914376 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:36.914343    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:37.395266 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:37.392607    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:53:37.403945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:37.395902    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:53:37.887060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:37.878318    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.303812 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.303775    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 20:53:38.465940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.450064    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" probeResult="failure" output="Get \"https://10.133.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.581044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.564657    5446 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.609123 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.609077    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.658297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.658257    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Oct 30 20:53:38.668043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.668004    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.692565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.692517    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": context deadline exceeded"
Oct 30 20:53:38.747217 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.702445    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": context deadline exceeded"
Oct 30 20:53:38.747217 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.703237    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Oct 30 20:53:38.773471 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.773425    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:38.773787 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.773754    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:38.776154 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.776121    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:38.833518 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.833430    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:38.913416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:38.913385    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:53:39.031147 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:39.031097    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerStarted","Data":"e2c26873eae1c5c7e58eab88f207cee3090438fb35fbd156fcf099c7b89f214b"}
Oct 30 20:53:40.043008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:40.042884    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerStarted","Data":"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"}
Oct 30 20:53:40.265946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:40.265867    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podStartSLOduration=4.26584763 podStartE2EDuration="4.26584763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:40.212349602 +0000 UTC m=+1586.204352740" watchObservedRunningTime="2026-10-30 20:53:40.26584763 +0000 UTC m=+1586.257850758"
Oct 30 20:53:40.917961 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:40.917931    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:40.923431 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:40.923410    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:41.052142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:41.052111    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:41.053210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:41.053190    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:53:43.190317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:43.190286    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:53:43.240905 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:43.240874    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:53:46.558093 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.558058    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:53:46.577109 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.577014    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.621050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.621015    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:53:46.663868 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.663835    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w5-0702ff-openshift-default-dockercfg-krdfv\""
Oct 30 20:53:46.667104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667073    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667118    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667260 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667232    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667377 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667361    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667464 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667436    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667491    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667551    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667608    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbk62\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.667702 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.667657    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771361 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771314    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771437    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771507    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771694 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771564    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771694 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771617    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbk62\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771694 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771664    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771766    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.771865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771800    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.771890    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.772048    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772270 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.772241    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772270 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.772261    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772503 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.772483    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.772771 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.772746    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.774847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.774818    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.775175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.775154    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.832455 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.832376    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.833199 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.833174    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbk62\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\") pod \"e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") " pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:46.954261 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:46.953898    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:47.462862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.462828    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:53:47.463389 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:53:47.463346    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3965dfb_d4a9_4fa9_ac03_576231952570.slice/crio-a98b7fae89b8c139cdc36cec9aee8bb9480561ec3e93d65cd028f6fff04921df WatchSource:0}: Error finding container a98b7fae89b8c139cdc36cec9aee8bb9480561ec3e93d65cd028f6fff04921df: Status 404 returned error can't find the container with id a98b7fae89b8c139cdc36cec9aee8bb9480561ec3e93d65cd028f6fff04921df
Oct 30 20:53:47.467174 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.467141    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:47.467293 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.467226    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:47.467293 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.467271    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:47.699939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.697017    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:53:47.699939 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.697215    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy" containerID="cri-o://6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad" gracePeriod=30
Oct 30 20:53:47.745991 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.745558    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:53:47.745991 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:47.745795    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy" containerID="cri-o://5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70" gracePeriod=30
Oct 30 20:53:48.123134 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.123101    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" event={"ID":"d3965dfb-d4a9-4fa9-ac03-576231952570","Type":"ContainerStarted","Data":"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"}
Oct 30 20:53:48.123295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.123152    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" event={"ID":"d3965dfb-d4a9-4fa9-ac03-576231952570","Type":"ContainerStarted","Data":"a98b7fae89b8c139cdc36cec9aee8bb9480561ec3e93d65cd028f6fff04921df"}
Oct 30 20:53:48.249019 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.248973    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podStartSLOduration=2.24895605 podStartE2EDuration="2.24895605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:48.248613685 +0000 UTC m=+1594.240616823" watchObservedRunningTime="2026-10-30 20:53:48.24895605 +0000 UTC m=+1594.240959255"
Oct 30 20:53:48.954708 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.954678    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:48.956333 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.956308    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:48.956459 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:48.956357    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:49.763696 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:49.763063    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:53:49.955563 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:49.955526    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:49.956211 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:49.956181    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:50.526550 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.526513    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:53:50.541887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.539443    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.632204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.632161    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w6-3d7c11-openshift-default-dockercfg-l4jgb\""
Oct 30 20:53:50.646162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.645061    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:53:50.727593 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727553    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727593 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727594    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s862x\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727795 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727687    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727791    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727824    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727860    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727903    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.727992 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.727958    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.728044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.728003    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830239    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830326    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830351    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830387    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830452    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830728    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830761    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s862x\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830829    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.830988    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.831852    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.832076    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832379 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.832201    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.832994 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.832826    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.833314 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.833290    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.835377 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.835347    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.835525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.835512    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.908092 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.906546    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.933001 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.931216    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s862x\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\") pod \"e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") " pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:50.955388 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.955357    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:50.955537 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:50.955409    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:51.157903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.157864    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:51.660399 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.660370    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:53:51.661337 ip-10-0-135-188 kubenswrapper[5446]: W1030 20:53:51.661314    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ce1bb6_df76_4453_951d_daa3b4d07ce9.slice/crio-259eef69874f97f0cb1036ffda3a05027d52d03b1013f60f583c38525067fd04 WatchSource:0}: Error finding container 259eef69874f97f0cb1036ffda3a05027d52d03b1013f60f583c38525067fd04: Status 404 returned error can't find the container with id 259eef69874f97f0cb1036ffda3a05027d52d03b1013f60f583c38525067fd04
Oct 30 20:53:51.664206 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.664174    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:51.664287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.664238    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:51.664287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.664266    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:53:51.959882 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.959193    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:51.960184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:51.960153    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:52.185964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:52.184604    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerStarted","Data":"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"}
Oct 30 20:53:52.185964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:52.184667    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerStarted","Data":"259eef69874f97f0cb1036ffda3a05027d52d03b1013f60f583c38525067fd04"}
Oct 30 20:53:52.444097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:52.444035    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podStartSLOduration=2.444016616 podStartE2EDuration="2.444016616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:52.439476475 +0000 UTC m=+1598.431479604" watchObservedRunningTime="2026-10-30 20:53:52.444016616 +0000 UTC m=+1598.436019743"
Oct 30 20:53:52.957619 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:52.956361    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:52.957619 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:52.956420    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:53.133632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.129379    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:53:53.159006 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.158977    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:53.164954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.164895    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:53.174823 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.174806    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.195242    5446 generic.go:356] "Generic (PLEG): container finished" podID="29c46c14-c659-4868-93a7-8aedb25985ce" containerID="5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70" exitCode=0
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.195468    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" event={"ID":"29c46c14-c659-4868-93a7-8aedb25985ce","Type":"ContainerDied","Data":"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"}
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.195520    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw" event={"ID":"29c46c14-c659-4868-93a7-8aedb25985ce","Type":"ContainerDied","Data":"4b3c30fb44351b9fbab6bcc8bc3a073ec7e87f6ec74e8dfc81b0e18e98d4185c"}
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.195550    5446 scope.go:122] "RemoveContainer" containerID="5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.195705    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.203547    5446 generic.go:356] "Generic (PLEG): container finished" podID="67338f1c-e52a-40ed-a431-06614b480d8a" containerID="6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad" exitCode=0
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.203837    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" event={"ID":"67338f1c-e52a-40ed-a431-06614b480d8a","Type":"ContainerDied","Data":"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"}
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.203882    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl" event={"ID":"67338f1c-e52a-40ed-a431-06614b480d8a","Type":"ContainerDied","Data":"7b7a0d2ad7218d246969e02e5337a19761f015862ac773148320560bbff1f6a9"}
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.204886    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.205600    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:53.211944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.206863    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:53:53.219226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.219206    5446 scope.go:122] "RemoveContainer" containerID="5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"
Oct 30 20:53:53.219534 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:53.219508    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70\": container with ID starting with 5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70 not found: ID does not exist" containerID="5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"
Oct 30 20:53:53.219635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.219538    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70"} err="failed to get container status \"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70\": rpc error: code = NotFound desc = could not find container \"5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70\": container with ID starting with 5f8e424be3ea0e58c1ebcb1907818a9cab7cf3d0745b6cb04fde57c5a5157b70 not found: ID does not exist"
Oct 30 20:53:53.219635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.219560    5446 scope.go:122] "RemoveContainer" containerID="6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"
Oct 30 20:53:53.221043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.220827    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.220869    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.220965    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221007    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221040    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221085    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221109    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221125    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221161    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221188    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221207    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221264    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221288    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.221447 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221445    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.222057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221485    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\") pod \"67338f1c-e52a-40ed-a431-06614b480d8a\" (UID: \"67338f1c-e52a-40ed-a431-06614b480d8a\") "
Oct 30 20:53:53.222057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221546    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.222057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221597    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.222057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221643    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.222057 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.221649    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\") pod \"29c46c14-c659-4868-93a7-8aedb25985ce\" (UID: \"29c46c14-c659-4868-93a7-8aedb25985ce\") "
Oct 30 20:53:53.222373 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.222107    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:53.222513 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.222488    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.222618 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.222598    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:53.222714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.222674    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.222896 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.222865    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.223191 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.223155    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.223904 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.223883    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29c46c14-c659-4868-93a7-8aedb25985ce-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.224109 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.224091    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.224219 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.224121    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67338f1c-e52a-40ed-a431-06614b480d8a-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.224731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.224488    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.225071    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.225183    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.224139    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.225330    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.225356    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.225651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.225377    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.226668 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.226641    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.226827 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.226806    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:53.227080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.227058    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:53.228497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.228469    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:53:53.228687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.228662    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g" pod "29c46c14-c659-4868-93a7-8aedb25985ce" (UID: "29c46c14-c659-4868-93a7-8aedb25985ce"). InnerVolumeSpecName "kube-api-access-kb58g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:53.230346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.230253    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:53:53.230346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.230330    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "kube-api-access-mk7cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:53.230843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.230812    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token" pod "67338f1c-e52a-40ed-a431-06614b480d8a" (UID: "67338f1c-e52a-40ed-a431-06614b480d8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:53.257313 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.257237    5446 scope.go:122] "RemoveContainer" containerID="6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"
Oct 30 20:53:53.257630 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:53.257577    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad\": container with ID starting with 6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad not found: ID does not exist" containerID="6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"
Oct 30 20:53:53.257630 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.257608    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad"} err="failed to get container status \"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad\": rpc error: code = NotFound desc = could not find container \"6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad\": container with ID starting with 6919736e0e4a6d9e974e28cee0c9a6131cc9b2457c16ccde9e5af8d5afc262ad not found: ID does not exist"
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327796    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327836    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk7cb\" (UniqueName: \"kubernetes.io/projected/67338f1c-e52a-40ed-a431-06614b480d8a-kube-api-access-mk7cb\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327853    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29c46c14-c659-4868-93a7-8aedb25985ce-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327868    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327882    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327896    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327910    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327942    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb58g\" (UniqueName: \"kubernetes.io/projected/29c46c14-c659-4868-93a7-8aedb25985ce-kube-api-access-kb58g\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327955    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67338f1c-e52a-40ed-a431-06614b480d8a-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327969    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67338f1c-e52a-40ed-a431-06614b480d8a-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.329783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.327982    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29c46c14-c659-4868-93a7-8aedb25985ce-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:53.732041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.732010    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:53:53.736626 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.736602    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-4lzrl"]
Oct 30 20:53:53.850625 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.850566    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:53:53.854311 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.854287    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-srztw"]
Oct 30 20:53:53.961162 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.961133    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Oct 30 20:53:53.961326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:53.961186    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Oct 30 20:53:54.135754 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:54.126512    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" path="/var/lib/kubelet/pods/29c46c14-c659-4868-93a7-8aedb25985ce/volumes"
Oct 30 20:53:54.135754 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:54.127892    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" path="/var/lib/kubelet/pods/67338f1c-e52a-40ed-a431-06614b480d8a/volumes"
Oct 30 20:53:54.960043 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:54.960016    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:54.960529 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:54.960318    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:54.961011 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:54.960991    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:53:58.212867 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.212830    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" containerID="cri-o://67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3" gracePeriod=45
Oct 30 20:53:58.262190 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.262154    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" containerID="cri-o://b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b" gracePeriod=45
Oct 30 20:53:58.578781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.578724    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:53:58.582108 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.582083    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:53:58.736895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.736816    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.736895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.736852    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.736895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.736887    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.737209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737037    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\" (UniqueName: \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.737209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737107    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.737209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737146    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.737209 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737184    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.737421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737215    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.737421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737266    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.737421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737392    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.737421 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737416    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\" (UniqueName: \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.737633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737499    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\" (UniqueName: \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.737633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737531    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\") pod \"3ce32708-48b6-43f0-8ced-04043f96cbbf\" (UID: \"3ce32708-48b6-43f0-8ced-04043f96cbbf\") "
Oct 30 20:53:58.737633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.737581    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\") pod \"87c7712e-566e-4544-b28d-1d261560561a\" (UID: \"87c7712e-566e-4544-b28d-1d261560561a\") "
Oct 30 20:53:58.738711 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.738532    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.738835 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.738743    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.739044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.738951    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.739044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.738968    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.739044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.739004    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.739044 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.739021    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.739434 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.739400    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.740438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.740406    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.741008 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.740982    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:58.741121 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.741000    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:58.741316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.741290    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:58.741964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.741943    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct" pod "3ce32708-48b6-43f0-8ced-04043f96cbbf" (UID: "3ce32708-48b6-43f0-8ced-04043f96cbbf"). InnerVolumeSpecName "kube-api-access-s5qct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:58.742631 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.742610    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh" pod "87c7712e-566e-4544-b28d-1d261560561a" (UID: "87c7712e-566e-4544-b28d-1d261560561a"). InnerVolumeSpecName "kube-api-access-hw5gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:58.841448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841408    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841448 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841447    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841461    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87c7712e-566e-4544-b28d-1d261560561a-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841477    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce32708-48b6-43f0-8ced-04043f96cbbf-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841490    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841506    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw5gh\" (UniqueName: \"kubernetes.io/projected/87c7712e-566e-4544-b28d-1d261560561a-kube-api-access-hw5gh\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841522    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5qct\" (UniqueName: \"kubernetes.io/projected/3ce32708-48b6-43f0-8ced-04043f96cbbf-kube-api-access-s5qct\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841535    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce32708-48b6-43f0-8ced-04043f96cbbf-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:58.841695 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:58.841548    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c7712e-566e-4544-b28d-1d261560561a-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:59.253556 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.253519    5446 generic.go:356] "Generic (PLEG): container finished" podID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerID="b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b" exitCode=0
Oct 30 20:53:59.254049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.253570    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"
Oct 30 20:53:59.254049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.253602    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" event={"ID":"3ce32708-48b6-43f0-8ced-04043f96cbbf","Type":"ContainerDied","Data":"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"}
Oct 30 20:53:59.254049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.253664    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" event={"ID":"3ce32708-48b6-43f0-8ced-04043f96cbbf","Type":"ContainerDied","Data":"90b42dab2208dad318ee5e53091708d332377f1647d6f165e304fe2cd842685a"}
Oct 30 20:53:59.254049 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.253686    5446 scope.go:122] "RemoveContainer" containerID="b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"
Oct 30 20:53:59.255975 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.255955    5446 generic.go:356] "Generic (PLEG): container finished" podID="87c7712e-566e-4544-b28d-1d261560561a" containerID="67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3" exitCode=0
Oct 30 20:53:59.256115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.256002    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"
Oct 30 20:53:59.256115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.256023    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" event={"ID":"87c7712e-566e-4544-b28d-1d261560561a","Type":"ContainerDied","Data":"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"}
Oct 30 20:53:59.256115 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.256064    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" event={"ID":"87c7712e-566e-4544-b28d-1d261560561a","Type":"ContainerDied","Data":"79870b57f22492014f9a1f8521c465fce16611678430906c136886be126debd1"}
Oct 30 20:53:59.265490 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.265475    5446 scope.go:122] "RemoveContainer" containerID="b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"
Oct 30 20:53:59.265801 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:59.265773    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b\": container with ID starting with b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b not found: ID does not exist" containerID="b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"
Oct 30 20:53:59.265853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.265814    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b"} err="failed to get container status \"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b\": rpc error: code = NotFound desc = could not find container \"b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b\": container with ID starting with b2223bddaad05515af55c9c802fbd4c8b8379d7199ca9ddbfb832a2bd831ad8b not found: ID does not exist"
Oct 30 20:53:59.265853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.265838    5446 scope.go:122] "RemoveContainer" containerID="67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"
Oct 30 20:53:59.276449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.276411    5446 scope.go:122] "RemoveContainer" containerID="67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"
Oct 30 20:53:59.276775 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:53:59.276738    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3\": container with ID starting with 67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3 not found: ID does not exist" containerID="67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"
Oct 30 20:53:59.276882 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.276776    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3"} err="failed to get container status \"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3\": rpc error: code = NotFound desc = could not find container \"67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3\": container with ID starting with 67f13759a627c38cb8c329485673402df1b41c70fdeeea44013645de139713b3 not found: ID does not exist"
Oct 30 20:53:59.422761 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.422719    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:53:59.431906 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.431877    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4"]
Oct 30 20:53:59.553997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.547622    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:53:59.553997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.549264    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:53:59.553997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.549702    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b32941/premium-w0-b32941-kserve-d9995b54f-8hlh4" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 20:53:59.576965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:53:59.574342    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b32941/distinct-2-w0-b32941-kserve-55858b66bc-57mcn"]
Oct 30 20:54:00.123077 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:00.123049    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" path="/var/lib/kubelet/pods/3ce32708-48b6-43f0-8ced-04043f96cbbf/volumes"
Oct 30 20:54:00.123603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:00.123589    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87c7712e-566e-4544-b28d-1d261560561a" path="/var/lib/kubelet/pods/87c7712e-566e-4544-b28d-1d261560561a/volumes"
Oct 30 20:54:02.071568 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:02.071531    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:54:02.072081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:02.071782    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy" containerID="cri-o://bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa" gracePeriod=30
Oct 30 20:54:07.350881 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.350812    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:54:07.358892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.358868    5446 generic.go:356] "Generic (PLEG): container finished" podID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerID="bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa" exitCode=0
Oct 30 20:54:07.359012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.358966    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" event={"ID":"e24bfd77-163f-44ed-85bd-1183caf372fa","Type":"ContainerDied","Data":"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"}
Oct 30 20:54:07.359012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.359001    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"
Oct 30 20:54:07.359012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.359009    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv" event={"ID":"e24bfd77-163f-44ed-85bd-1183caf372fa","Type":"ContainerDied","Data":"957725e222c4c253aa19dc259ba5e961a843f438cd7717fcb0387a2daff40277"}
Oct 30 20:54:07.359123 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.359031    5446 scope.go:122] "RemoveContainer" containerID="bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"
Oct 30 20:54:07.369123 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.369099    5446 scope.go:122] "RemoveContainer" containerID="bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"
Oct 30 20:54:07.369411 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:54:07.369393    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa\": container with ID starting with bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa not found: ID does not exist" containerID="bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"
Oct 30 20:54:07.369449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.369425    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa"} err="failed to get container status \"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa\": rpc error: code = NotFound desc = could not find container \"bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa\": container with ID starting with bcc4f8bde124ef2f2284dcabfd3286e1ff7ca17b3c8e3dced62c4e0c6e7827fa not found: ID does not exist"
Oct 30 20:54:07.505621 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505591    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.505749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505657    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.505749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505684    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.505749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505720    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.505749 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505744    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.506033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505827    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.506033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505896    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.506033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505967    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.506033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.505989    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:07.506033 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.506021    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\") pod \"e24bfd77-163f-44ed-85bd-1183caf372fa\" (UID: \"e24bfd77-163f-44ed-85bd-1183caf372fa\") "
Oct 30 20:54:07.506703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.506192    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:07.506703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.506210    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:07.506703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.506223    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:07.506703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.506580    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:54:07.507071 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.507049    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.507159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.507076    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e24bfd77-163f-44ed-85bd-1183caf372fa-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.507159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.507091    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.507159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.507108    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.507159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.507122    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.508242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.508219    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:07.508540 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.508520    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:07.508672 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.508653    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:54:07.508741 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.508724    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g" pod "e24bfd77-163f-44ed-85bd-1183caf372fa" (UID: "e24bfd77-163f-44ed-85bd-1183caf372fa"). InnerVolumeSpecName "kube-api-access-bkp7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:07.609021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.608955    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkp7g\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-kube-api-access-bkp7g\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.609021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.608979    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.609021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.608989    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.609021 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.608997    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e24bfd77-163f-44ed-85bd-1183caf372fa-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:07.825944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.825046    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:54:07.825944 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:07.825756    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-92tqv"]
Oct 30 20:54:08.128545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:08.128503    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" path="/var/lib/kubelet/pods/e24bfd77-163f-44ed-85bd-1183caf372fa/volumes"
Oct 30 20:54:19.537322 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:54:19.537276    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:54:36.156839 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.156763    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:54:36.157396 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.156967    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" podUID="b1df9727-0c12-4c88-a238-ed274236a9ef" containerName="maas-api" containerID="cri-o://e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206" gracePeriod=30
Oct 30 20:54:36.496460 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.496430    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:54:36.558251 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.558227    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") pod \"b1df9727-0c12-4c88-a238-ed274236a9ef\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") "
Oct 30 20:54:36.558388 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.558344    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\" (UniqueName: \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\") pod \"b1df9727-0c12-4c88-a238-ed274236a9ef\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") "
Oct 30 20:54:36.558458 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.558446    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\") pod \"b1df9727-0c12-4c88-a238-ed274236a9ef\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") "
Oct 30 20:54:36.558521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.558469    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\") pod \"b1df9727-0c12-4c88-a238-ed274236a9ef\" (UID: \"b1df9727-0c12-4c88-a238-ed274236a9ef\") "
Oct 30 20:54:36.558778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.558740    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca" pod "b1df9727-0c12-4c88-a238-ed274236a9ef" (UID: "b1df9727-0c12-4c88-a238-ed274236a9ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:54:36.559166 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.559149    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1df9727-0c12-4c88-a238-ed274236a9ef-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:36.560533 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.560508    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls" pod "b1df9727-0c12-4c88-a238-ed274236a9ef" (UID: "b1df9727-0c12-4c88-a238-ed274236a9ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:54:36.560642 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.560570    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs" pod "b1df9727-0c12-4c88-a238-ed274236a9ef" (UID: "b1df9727-0c12-4c88-a238-ed274236a9ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:54:36.560704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.560682    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2" pod "b1df9727-0c12-4c88-a238-ed274236a9ef" (UID: "b1df9727-0c12-4c88-a238-ed274236a9ef"). InnerVolumeSpecName "kube-api-access-ptwj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:36.663195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.663161    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:36.663195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.663193    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1df9727-0c12-4c88-a238-ed274236a9ef-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:36.663439 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.663205    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptwj2\" (UniqueName: \"kubernetes.io/projected/b1df9727-0c12-4c88-a238-ed274236a9ef-kube-api-access-ptwj2\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:36.746367 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.746288    5446 generic.go:356] "Generic (PLEG): container finished" podID="b1df9727-0c12-4c88-a238-ed274236a9ef" containerID="e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206" exitCode=0
Oct 30 20:54:36.746367 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.746354    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"
Oct 30 20:54:36.746598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.746370    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" event={"ID":"b1df9727-0c12-4c88-a238-ed274236a9ef","Type":"ContainerDied","Data":"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"}
Oct 30 20:54:36.746598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.746430    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w" event={"ID":"b1df9727-0c12-4c88-a238-ed274236a9ef","Type":"ContainerDied","Data":"1fe8d6961d15dc603a5bfb6a68c8a413681d2cf7d1595742f48751fee96e9631"}
Oct 30 20:54:36.746598 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.746457    5446 scope.go:122] "RemoveContainer" containerID="e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"
Oct 30 20:54:36.777896 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.777873    5446 scope.go:122] "RemoveContainer" containerID="e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"
Oct 30 20:54:36.778339 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:54:36.778313    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206\": container with ID starting with e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206 not found: ID does not exist" containerID="e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"
Oct 30 20:54:36.778515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.778346    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206"} err="failed to get container status \"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206\": rpc error: code = NotFound desc = could not find container \"e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206\": container with ID starting with e381b65e583d6a507ed4c25db5860c23b01da6bd1637e34f09a5670838dca206 not found: ID does not exist"
Oct 30 20:54:36.913770 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.913740    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:54:36.919539 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:36.919504    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ad0ff4fc-5fdb5bf967-4np4w"]
Oct 30 20:54:38.121757 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:38.121724    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1df9727-0c12-4c88-a238-ed274236a9ef" path="/var/lib/kubelet/pods/b1df9727-0c12-4c88-a238-ed274236a9ef/volumes"
Oct 30 20:54:48.712807 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:48.712772    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:54:48.762011 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:48.761978    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:54:48.765753 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:54:48.765711    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:54:49.518624 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:54:49.518589    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:55:03.735012 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:03.734947    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main" containerID="cri-o://62cb6c5495ca93fdfa24dca95eda141ebeecac1acf9a7cc27db2fd3f863f9f00" gracePeriod=45
Oct 30 20:55:03.783416 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:03.783376    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main" containerID="cri-o://14b112369cc1da087d02548b9c547b4cd02464c788ce6b693fa20a436463be86" gracePeriod=45
Oct 30 20:55:03.786152 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:03.786117    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main" containerID="cri-o://3af0c0eac898e5f6ff1de814664b9d8c2d10f29f578d45d71f407089beef2967" gracePeriod=45
Oct 30 20:55:04.022083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.018349    5446 generic.go:356] "Generic (PLEG): container finished" podID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerID="62cb6c5495ca93fdfa24dca95eda141ebeecac1acf9a7cc27db2fd3f863f9f00" exitCode=0
Oct 30 20:55:04.022083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.018462    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" event={"ID":"b2ec952f-084e-4eb6-9a16-b00c4aef19d3","Type":"ContainerDied","Data":"62cb6c5495ca93fdfa24dca95eda141ebeecac1acf9a7cc27db2fd3f863f9f00"}
Oct 30 20:55:04.022083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.021866    5446 generic.go:356] "Generic (PLEG): container finished" podID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerID="3af0c0eac898e5f6ff1de814664b9d8c2d10f29f578d45d71f407089beef2967" exitCode=0
Oct 30 20:55:04.022347 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.022129    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" event={"ID":"576df3c2-c1cd-4e35-9dfd-4797092f2c29","Type":"ContainerDied","Data":"3af0c0eac898e5f6ff1de814664b9d8c2d10f29f578d45d71f407089beef2967"}
Oct 30 20:55:04.026572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.024005    5446 generic.go:356] "Generic (PLEG): container finished" podID="06558642-9198-456e-86cc-b4644dc8da26" containerID="14b112369cc1da087d02548b9c547b4cd02464c788ce6b693fa20a436463be86" exitCode=0
Oct 30 20:55:04.026572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.024098    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" event={"ID":"06558642-9198-456e-86cc-b4644dc8da26","Type":"ContainerDied","Data":"14b112369cc1da087d02548b9c547b4cd02464c788ce6b693fa20a436463be86"}
Oct 30 20:55:04.147774 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.147743    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:55:04.151249 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.151227    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:55:04.157212 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.157187    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:55:04.255897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.255824    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.255897 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.255875    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.256132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.255953    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.256132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.255990    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256020    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256049    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.256132 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256099    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256136    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256150    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256195    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256230    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256248    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256267    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\" (UniqueName: \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256348    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256418    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256456    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256471    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\" (UniqueName: \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256514    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\" (UniqueName: \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256558    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256594    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256630    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\") pod \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\" (UID: \"576df3c2-c1cd-4e35-9dfd-4797092f2c29\") "
Oct 30 20:55:04.256687 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256651    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.257142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256707    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\" (UniqueName: \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\") pod \"06558642-9198-456e-86cc-b4644dc8da26\" (UID: \"06558642-9198-456e-86cc-b4644dc8da26\") "
Oct 30 20:55:04.257142 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256731    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\") pod \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\" (UID: \"b2ec952f-084e-4eb6-9a16-b00c4aef19d3\") "
Oct 30 20:55:04.257394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.256812    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.258185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.258152    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.262400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.260804    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273584    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273616    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273629    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273642    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273654    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273664    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273674    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273685    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.273696    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.290990 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.274813    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "kube-api-access-xpg5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:04.304936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.294095    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:04.320732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.319153    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:04.321308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.321130    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "kube-api-access-4sj8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:04.331080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.330807    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.331080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.330812    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm" pod "06558642-9198-456e-86cc-b4644dc8da26" (UID: "06558642-9198-456e-86cc-b4644dc8da26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.331080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.330947    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs" pod "576df3c2-c1cd-4e35-9dfd-4797092f2c29" (UID: "576df3c2-c1cd-4e35-9dfd-4797092f2c29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:04.331080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.331007    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:04.331080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.331044    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r" pod "b2ec952f-084e-4eb6-9a16-b00c4aef19d3" (UID: "b2ec952f-084e-4eb6-9a16-b00c4aef19d3"). InnerVolumeSpecName "kube-api-access-qxg6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375820    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxg6r\" (UniqueName: \"kubernetes.io/projected/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-kube-api-access-qxg6r\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375861    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576df3c2-c1cd-4e35-9dfd-4797092f2c29-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375878    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpg5q\" (UniqueName: \"kubernetes.io/projected/576df3c2-c1cd-4e35-9dfd-4797092f2c29-kube-api-access-xpg5q\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375891    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375905    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06558642-9198-456e-86cc-b4644dc8da26-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375960    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576df3c2-c1cd-4e35-9dfd-4797092f2c29-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375974    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06558642-9198-456e-86cc-b4644dc8da26-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375986    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sj8d\" (UniqueName: \"kubernetes.io/projected/06558642-9198-456e-86cc-b4644dc8da26-kube-api-access-4sj8d\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:04.376028 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:04.375999    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ec952f-084e-4eb6-9a16-b00c4aef19d3-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:05.032308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.032241    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"
Oct 30 20:55:05.032308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.032278    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk" event={"ID":"06558642-9198-456e-86cc-b4644dc8da26","Type":"ContainerDied","Data":"bd00ff8f6bf799a9a9ffe944eba9c15d6fd3c26d412211c3570b27cbfc0f0244"}
Oct 30 20:55:05.032806 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.032330    5446 scope.go:122] "RemoveContainer" containerID="14b112369cc1da087d02548b9c547b4cd02464c788ce6b693fa20a436463be86"
Oct 30 20:55:05.033821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.033803    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"
Oct 30 20:55:05.033904 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.033818    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv" event={"ID":"b2ec952f-084e-4eb6-9a16-b00c4aef19d3","Type":"ContainerDied","Data":"32ce01bca7e03a051d90fe814a88e2eb4772e5373a4ff18dfc4b65156f94afcc"}
Oct 30 20:55:05.035394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.035364    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8" event={"ID":"576df3c2-c1cd-4e35-9dfd-4797092f2c29","Type":"ContainerDied","Data":"f8e026db0327d7f6baf87a47685c8d650f55c4c614392168dd8589a4b5558cc1"}
Oct 30 20:55:05.035394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.035374    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"
Oct 30 20:55:05.044222 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.044068    5446 scope.go:122] "RemoveContainer" containerID="62cb6c5495ca93fdfa24dca95eda141ebeecac1acf9a7cc27db2fd3f863f9f00"
Oct 30 20:55:05.053803 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.053781    5446 scope.go:122] "RemoveContainer" containerID="3af0c0eac898e5f6ff1de814664b9d8c2d10f29f578d45d71f407089beef2967"
Oct 30 20:55:05.199840 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.199812    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:55:05.248740 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.248710    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-w1-86d620-kserve-6c7ff98ff8-b7chk"]
Oct 30 20:55:05.358678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.358611    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:55:05.361675 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.361656    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/distinct-2-w1-86d620-kserve-788ccdbd8f-bgpzv"]
Oct 30 20:55:05.473761 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.473731    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:55:05.481121 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:05.481098    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-86d620/simulator-w1-86d620-kserve-5d445fcf94-rr4z8"]
Oct 30 20:55:06.121497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:06.121467    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06558642-9198-456e-86cc-b4644dc8da26" path="/var/lib/kubelet/pods/06558642-9198-456e-86cc-b4644dc8da26/volumes"
Oct 30 20:55:06.121973 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:06.121957    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" path="/var/lib/kubelet/pods/576df3c2-c1cd-4e35-9dfd-4797092f2c29/volumes"
Oct 30 20:55:06.122378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:06.122365    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" path="/var/lib/kubelet/pods/b2ec952f-084e-4eb6-9a16-b00c4aef19d3/volumes"
Oct 30 20:55:19.533689 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:55:19.533600    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:55:21.179239 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.179205    5446 generic.go:356] "Generic (PLEG): container finished" podID="11971513-145a-4013-917d-e2addc37ffd1" containerID="485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea" exitCode=0
Oct 30 20:55:21.180051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.179277    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerDied","Data":"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"}
Oct 30 20:55:21.180051 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.179603    5446 scope.go:122] "RemoveContainer" containerID="485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"
Oct 30 20:55:21.181092 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.181060    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:21.181217 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.181145    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:21.181217 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:21.181196    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:22.187600 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:22.187567    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerStarted","Data":"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"}
Oct 30 20:55:22.917460 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:22.917429    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:55:22.918419 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:22.918395    5446 patch_prober.go:29] interesting pod/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:55:22.918561 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:22.918439    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Oct 30 20:55:23.857649 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:23.857614    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:55:23.858147 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:23.857865    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" podUID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" containerName="maas-api" containerID="cri-o://5f469a6c6044eeae761d075caef06c6006dbd2b7d3704b949cd01616b7aac80b" gracePeriod=30
Oct 30 20:55:23.919479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:23.919449    5446 patch_prober.go:29] interesting pod/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:55:23.919715 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:23.919692    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Oct 30 20:55:24.473204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.473168    5446 generic.go:356] "Generic (PLEG): container finished" podID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" containerID="5f469a6c6044eeae761d075caef06c6006dbd2b7d3704b949cd01616b7aac80b" exitCode=0
Oct 30 20:55:24.473799 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.473776    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" event={"ID":"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116","Type":"ContainerDied","Data":"5f469a6c6044eeae761d075caef06c6006dbd2b7d3704b949cd01616b7aac80b"}
Oct 30 20:55:24.479738 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.479719    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:55:24.534398 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.534310    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\") pod \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") "
Oct 30 20:55:24.534572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.534427    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\" (UniqueName: \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\") pod \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") "
Oct 30 20:55:24.534572 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.534561    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\") pod \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") "
Oct 30 20:55:24.534704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.534647    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") pod \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\" (UID: \"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116\") "
Oct 30 20:55:24.535531 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.535497    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca" pod "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" (UID: "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:24.535743 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.535717    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:24.537493 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.537468    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs" pod "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" (UID: "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:24.537867 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.537820    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls" pod "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" (UID: "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:24.537867 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.537826    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9" pod "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" (UID: "2f9f5b53-fd3f-4c48-a753-db6f3ef6e116"). InnerVolumeSpecName "kube-api-access-g9wg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:24.637620 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.637587    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:24.637620 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.637615    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9wg9\" (UniqueName: \"kubernetes.io/projected/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-kube-api-access-g9wg9\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:24.637865 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.637637    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:24.917326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.917294    5446 patch_prober.go:29] interesting pod/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:55:24.917823 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:24.917366    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Oct 30 20:55:25.531945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.531447    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m" event={"ID":"2f9f5b53-fd3f-4c48-a753-db6f3ef6e116","Type":"ContainerDied","Data":"6138480ca05b440a7c44ec43c5af80744635ff6d35e7c0d09f02fdcf6b7e17bb"}
Oct 30 20:55:25.531945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.531543    5446 scope.go:122] "RemoveContainer" containerID="5f469a6c6044eeae761d075caef06c6006dbd2b7d3704b949cd01616b7aac80b"
Oct 30 20:55:25.531945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.531774    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"
Oct 30 20:55:25.715240 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.715204    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:55:25.754317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.754289    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b32941-69bbbd79b-dpw2m"]
Oct 30 20:55:25.917384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.917348    5446 patch_prober.go:29] interesting pod/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:55:25.917883 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:25.917423    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Oct 30 20:55:26.052184 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:26.052154    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:55:26.123359 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:26.123327    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" path="/var/lib/kubelet/pods/2f9f5b53-fd3f-4c48-a753-db6f3ef6e116/volumes"
Oct 30 20:55:26.918954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:26.917300    5446 patch_prober.go:29] interesting pod/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Oct 30 20:55:26.918954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:26.917442    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Oct 30 20:55:27.922019 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:27.921991    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:55:27.923038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:27.923017    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:55:36.501004 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.500965    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:55:36.501785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.501752    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" containerID="cri-o://a7ac833b0021522a888db2b58a481d6a743c6d906c2d8b6d299c442fc0528477" gracePeriod=30
Oct 30 20:55:36.523037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.523002    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:55:36.523492 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.523456    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" containerID="cri-o://8b90e4a2a3c129d16e7eff6be2c18dd1d695aa3fb86bf00da8ef279eb8392682" gracePeriod=30
Oct 30 20:55:36.536744 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.536720    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:55:36.536954 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.536907    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" containerID="cri-o://8a9182cd5926bc943ba4f00227947d1ecc850d16d2aa2d3329f8883c5370671b" gracePeriod=30
Oct 30 20:55:36.918998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.918863    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:55:36.918998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:36.918955    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:55:39.247081 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.247042    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:55:39.247482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.247109    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:55:39.322811 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.322767    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:55:39.323038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.322841    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:55:39.906480 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.906449    5446 patch_prober.go:29] interesting pod/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:55:39.906658 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:39.906507    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:55:41.785671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.785331    5446 generic.go:356] "Generic (PLEG): container finished" podID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerID="8a9182cd5926bc943ba4f00227947d1ecc850d16d2aa2d3329f8883c5370671b" exitCode=0
Oct 30 20:55:41.785671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.785500    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" event={"ID":"2a2af59a-80c9-42a9-a9af-d972710280d8","Type":"ContainerDied","Data":"8a9182cd5926bc943ba4f00227947d1ecc850d16d2aa2d3329f8883c5370671b"}
Oct 30 20:55:41.787640 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.787553    5446 generic.go:356] "Generic (PLEG): container finished" podID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerID="8b90e4a2a3c129d16e7eff6be2c18dd1d695aa3fb86bf00da8ef279eb8392682" exitCode=0
Oct 30 20:55:41.787783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.787681    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" event={"ID":"2cb944a1-df15-40cc-be03-d1dca27f799b","Type":"ContainerDied","Data":"8b90e4a2a3c129d16e7eff6be2c18dd1d695aa3fb86bf00da8ef279eb8392682"}
Oct 30 20:55:41.791499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.789565    5446 generic.go:356] "Generic (PLEG): container finished" podID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerID="a7ac833b0021522a888db2b58a481d6a743c6d906c2d8b6d299c442fc0528477" exitCode=0
Oct 30 20:55:41.791499 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.789666    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" event={"ID":"a6d023d8-fc01-4c15-9e22-c39592c46938","Type":"ContainerDied","Data":"a7ac833b0021522a888db2b58a481d6a743c6d906c2d8b6d299c442fc0528477"}
Oct 30 20:55:41.863227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.863069    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:55:41.971323 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.971198    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:55:41.986475 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:41.985998    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.013778    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.013881    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014102    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014188    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014225    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014264    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014299    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014334    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014392    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014428    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014514    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014545    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014577    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014628    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014670    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014739    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014772    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014803    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.014834    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.015000    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\") pod \"2cb944a1-df15-40cc-be03-d1dca27f799b\" (UID: \"2cb944a1-df15-40cc-be03-d1dca27f799b\") "
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.015275    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.015793    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.016121    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.016161    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.016311    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.016941 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.016332    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017296    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017317    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017333    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017348    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cb944a1-df15-40cc-be03-d1dca27f799b-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017362    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017384    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.017760    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.018045    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.018327    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.018441    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.018573    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.018794 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.018742    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.019738 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.019716    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.029940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.029898    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.030054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.029982    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.030122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.030072    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "kube-api-access-trpz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.030197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.030177    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.031863 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.031836    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7" pod "2cb944a1-df15-40cc-be03-d1dca27f799b" (UID: "2cb944a1-df15-40cc-be03-d1dca27f799b"). InnerVolumeSpecName "kube-api-access-xslh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.032287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.032260    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.032670 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.032634    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.118887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.118235    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.118887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.118346    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.118887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.118377    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.118887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.118437    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.118887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.118520    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120062    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\") pod \"a6d023d8-fc01-4c15-9e22-c39592c46938\" (UID: \"a6d023d8-fc01-4c15-9e22-c39592c46938\") "
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120173    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\") pod \"2a2af59a-80c9-42a9-a9af-d972710280d8\" (UID: \"2a2af59a-80c9-42a9-a9af-d972710280d8\") "
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120797    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120817    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2af59a-80c9-42a9-a9af-d972710280d8-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120831    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120846    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120858    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120872    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6d023d8-fc01-4c15-9e22-c39592c46938-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120884    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120898    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120940    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xslh7\" (UniqueName: \"kubernetes.io/projected/2cb944a1-df15-40cc-be03-d1dca27f799b-kube-api-access-xslh7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120956    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120970    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trpz2\" (UniqueName: \"kubernetes.io/projected/2a2af59a-80c9-42a9-a9af-d972710280d8-kube-api-access-trpz2\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120984    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.120998    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.121193 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.121010    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cb944a1-df15-40cc-be03-d1dca27f799b-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.125635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.122646    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.125635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.122939    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.125635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.125595    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:55:42.128363 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.128335    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:55:42.132034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.131999    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "kube-api-access-rm6sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.132369 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.132220    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo" pod "2a2af59a-80c9-42a9-a9af-d972710280d8" (UID: "2a2af59a-80c9-42a9-a9af-d972710280d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:55:42.132766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.132736    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token" pod "a6d023d8-fc01-4c15-9e22-c39592c46938" (UID: "a6d023d8-fc01-4c15-9e22-c39592c46938"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:42.222061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222030    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222060    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm6sl\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-kube-api-access-rm6sl\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222073    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222086    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2af59a-80c9-42a9-a9af-d972710280d8-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222099    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2af59a-80c9-42a9-a9af-d972710280d8-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222111    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6d023d8-fc01-4c15-9e22-c39592c46938-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.222243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.222119    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6d023d8-fc01-4c15-9e22-c39592c46938-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:42.796903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.796871    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"
Oct 30 20:55:42.796903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.796887    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw" event={"ID":"2a2af59a-80c9-42a9-a9af-d972710280d8","Type":"ContainerDied","Data":"66be10b2ca8620d7bbd677bfce2eedb56cbb9cbe455c7f712924d4d77ebfec58"}
Oct 30 20:55:42.797449 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.797009    5446 scope.go:122] "RemoveContainer" containerID="8a9182cd5926bc943ba4f00227947d1ecc850d16d2aa2d3329f8883c5370671b"
Oct 30 20:55:42.798424 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.798406    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"
Oct 30 20:55:42.798510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.798434    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5" event={"ID":"2cb944a1-df15-40cc-be03-d1dca27f799b","Type":"ContainerDied","Data":"758efb131655d53375f941432cc5e0b5069316555c7e0940d8ad7c6969e635ac"}
Oct 30 20:55:42.800790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.800764    5446 generic.go:356] "Generic (PLEG): container finished" podID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerID="472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a" exitCode=0
Oct 30 20:55:42.800940 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.800860    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerDied","Data":"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"}
Oct 30 20:55:42.801320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.801301    5446 scope.go:122] "RemoveContainer" containerID="472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"
Oct 30 20:55:42.802553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.802533    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq" event={"ID":"a6d023d8-fc01-4c15-9e22-c39592c46938","Type":"ContainerDied","Data":"d6f616a12f7e1c531c8a16db0ef7be1f6c34da3b3efe9fd6f86fafa87ce8aba8"}
Oct 30 20:55:42.802635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.802561    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"
Oct 30 20:55:42.802891 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.802869    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:42.802982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.802968    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:42.803022 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.803008    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:42.808346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.808327    5446 scope.go:122] "RemoveContainer" containerID="8b90e4a2a3c129d16e7eff6be2c18dd1d695aa3fb86bf00da8ef279eb8392682"
Oct 30 20:55:42.820247 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.820225    5446 scope.go:122] "RemoveContainer" containerID="a7ac833b0021522a888db2b58a481d6a743c6d906c2d8b6d299c442fc0528477"
Oct 30 20:55:42.965788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.965755    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:55:42.999758 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:42.999724    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-fc7r5"]
Oct 30 20:55:43.079308 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:43.079225    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:55:43.083633 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:43.083610    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-7jmnq"]
Oct 30 20:55:43.320491 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:43.320444    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:55:43.323470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:43.323446    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b32941-openshift-default-649798b65f-rlxlw"]
Oct 30 20:55:43.821506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:43.821472    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerStarted","Data":"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"}
Oct 30 20:55:44.123736 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.123703    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" path="/var/lib/kubelet/pods/2a2af59a-80c9-42a9-a9af-d972710280d8/volumes"
Oct 30 20:55:44.124263 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.124247    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" path="/var/lib/kubelet/pods/2cb944a1-df15-40cc-be03-d1dca27f799b/volumes"
Oct 30 20:55:44.124684 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.124671    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" path="/var/lib/kubelet/pods/a6d023d8-fc01-4c15-9e22-c39592c46938/volumes"
Oct 30 20:55:44.158955 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.158910    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:55:44.159107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.159089    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:55:44.159161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:44.159137    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Oct 30 20:55:45.158305 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:45.158268    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:55:45.158699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:45.158342    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Oct 30 20:55:46.159052 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:46.159017    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:55:46.159524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:46.159085    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Oct 30 20:55:47.159075 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:47.159037    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:55:47.159465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:47.159102    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Oct 30 20:55:48.158609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:48.158576    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused" start-of-body=
Oct 30 20:55:48.158802 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:48.158625    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.98:15021/healthz/ready\": dial tcp 10.133.0.98:15021: connect: connection refused"
Oct 30 20:55:49.162452 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:49.162415    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:55:49.162945 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:49.162902    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:55:49.163562 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:55:49.163543    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:55:49.519457 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:55:49.519370    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:56:19.518596 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:19.518560    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:56:38.913812 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:38.913778    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:56:38.914362 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:38.913982    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy" containerID="cri-o://7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4" gracePeriod=30
Oct 30 20:56:38.929764 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:38.929736    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:56:38.929957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:38.929936    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy" containerID="cri-o://bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99" gracePeriod=30
Oct 30 20:56:44.216659 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.216631    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:56:44.261887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.261866    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:56:44.290783 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.290757    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.290950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.290792    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.290950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.290810    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291010    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291034    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291037    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.291090 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291082    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291119    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291176    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291297 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291220    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\") pod \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\" (UID: \"98c6e90c-c3d8-4862-bbd9-84c4bf782946\") "
Oct 30 20:56:44.291599 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291496    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.291599 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291604    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:44.291841 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.291609    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.292127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.292103    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.292235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.292133    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.292235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.292149    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.292235 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.292179    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.292394 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.292256    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.293548 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293519    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:44.293644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293531    5446 generic.go:356] "Generic (PLEG): container finished" podID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerID="7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4" exitCode=0
Oct 30 20:56:44.293644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293559    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" event={"ID":"98c6e90c-c3d8-4862-bbd9-84c4bf782946","Type":"ContainerDied","Data":"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"}
Oct 30 20:56:44.293644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293594    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"
Oct 30 20:56:44.293644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293611    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp" event={"ID":"98c6e90c-c3d8-4862-bbd9-84c4bf782946","Type":"ContainerDied","Data":"1186d9d2b723dcfef25da1659056d64415da1ea8e355bff34d4afd1fdc3b9a19"}
Oct 30 20:56:44.293644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293640    5446 scope.go:122] "RemoveContainer" containerID="7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"
Oct 30 20:56:44.293856 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.293559    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:56:44.294061 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.294038    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "kube-api-access-bp8nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:44.294148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.294087    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy" pod "98c6e90c-c3d8-4862-bbd9-84c4bf782946" (UID: "98c6e90c-c3d8-4862-bbd9-84c4bf782946"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.295741 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.295721    5446 generic.go:356] "Generic (PLEG): container finished" podID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerID="bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99" exitCode=0
Oct 30 20:56:44.295844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.295769    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"
Oct 30 20:56:44.295844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.295787    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerDied","Data":"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"}
Oct 30 20:56:44.295844 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.295833    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9" event={"ID":"c0ce08fb-ea2f-4937-b9a6-d187bdb08647","Type":"ContainerDied","Data":"6a22d581a2f69ea1533099c9daf3d4344698c0b8563985d4df6182b1a5fd2040"}
Oct 30 20:56:44.303717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.303700    5446 scope.go:122] "RemoveContainer" containerID="7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"
Oct 30 20:56:44.304016 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:44.303991    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4\": container with ID starting with 7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4 not found: ID does not exist" containerID="7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"
Oct 30 20:56:44.304069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.304025    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4"} err="failed to get container status \"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4\": rpc error: code = NotFound desc = could not find container \"7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4\": container with ID starting with 7625291b8bdaa2c3eccaa402259879eab498dcfb474489b4f2f0bc0f863baad4 not found: ID does not exist"
Oct 30 20:56:44.304069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.304041    5446 scope.go:122] "RemoveContainer" containerID="bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"
Oct 30 20:56:44.313087 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.313071    5446 scope.go:122] "RemoveContainer" containerID="420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"
Oct 30 20:56:44.321787 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.321770    5446 scope.go:122] "RemoveContainer" containerID="bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"
Oct 30 20:56:44.322165 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:44.322147    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99\": container with ID starting with bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99 not found: ID does not exist" containerID="bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"
Oct 30 20:56:44.322237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.322170    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99"} err="failed to get container status \"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99\": rpc error: code = NotFound desc = could not find container \"bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99\": container with ID starting with bc140e38fa02afdc8b11f604c282f0b3462b1eeb6c514451a056a8eaefe50d99 not found: ID does not exist"
Oct 30 20:56:44.322237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.322187    5446 scope.go:122] "RemoveContainer" containerID="420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"
Oct 30 20:56:44.322453 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:44.322436    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538\": container with ID starting with 420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538 not found: ID does not exist" containerID="420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"
Oct 30 20:56:44.322591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.322461    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538"} err="failed to get container status \"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538\": rpc error: code = NotFound desc = could not find container \"420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538\": container with ID starting with 420f66989ac8dbb7491940b8cbef6b0ca4f6ec32d9b1816850d7e62561dba538 not found: ID does not exist"
Oct 30 20:56:44.393041 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393009    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393076    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393130    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393207 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393181    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393234    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393279    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.393381 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393345    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393542 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393485    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393603 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393575    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393604    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\") pod \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\" (UID: \"c0ce08fb-ea2f-4937-b9a6-d187bdb08647\") "
Oct 30 20:56:44.393717 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393676    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.393830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.393802    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.394149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394085    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.394149 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394124    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:44.394428 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394406    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.394496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394429    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.394496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394443    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.394496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394458    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.394496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394472    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.394496 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394494    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.395088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394508    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.395088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394524    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.395088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394538    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98c6e90c-c3d8-4862-bbd9-84c4bf782946-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.395088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.394552    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp8nm\" (UniqueName: \"kubernetes.io/projected/98c6e90c-c3d8-4862-bbd9-84c4bf782946-kube-api-access-bp8nm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.396110 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.396086    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "kube-api-access-cbn88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:44.396320 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.396301    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:56:44.396543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.396529    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:44.396593 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.396563    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token" pod "c0ce08fb-ea2f-4937-b9a6-d187bdb08647" (UID: "c0ce08fb-ea2f-4937-b9a6-d187bdb08647"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:44.495579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.495507    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.495579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.495536    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbn88\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-kube-api-access-cbn88\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.495579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.495549    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.495579 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.495558    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ce08fb-ea2f-4937-b9a6-d187bdb08647-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:44.735243 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.735209    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:56:44.741427 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.741389    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-88nxp"]
Oct 30 20:56:44.857281 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.857188    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:56:44.862412 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:44.862385    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-86d620-openshift-default-6646b648bc-v28x9"]
Oct 30 20:56:46.122182 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:46.122149    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" path="/var/lib/kubelet/pods/98c6e90c-c3d8-4862-bbd9-84c4bf782946/volumes"
Oct 30 20:56:46.122638 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:46.122623    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" path="/var/lib/kubelet/pods/c0ce08fb-ea2f-4937-b9a6-d187bdb08647/volumes"
Oct 30 20:56:49.517008 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:49.516974    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:56:51.622987 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:51.622959    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:56:51.729010 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:51.728981    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:56:56.624079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:56.624023    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" podUID="0122e012-b737-4de4-bc2d-5d788f033f8d" containerName="payload-processing" containerID="cri-o://2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444" gracePeriod=25
Oct 30 20:56:56.729710 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:56.729645    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" podUID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" containerName="payload-pre-processing" containerID="cri-o://62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673" gracePeriod=25
Oct 30 20:56:56.905351 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:56.905222    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:56:57.003938 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.003894    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:56:57.020453 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.020431    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\") pod \"0122e012-b737-4de4-bc2d-5d788f033f8d\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") "
Oct 30 20:56:57.021539 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.020771    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\" (UniqueName: \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\") pod \"0122e012-b737-4de4-bc2d-5d788f033f8d\" (UID: \"0122e012-b737-4de4-bc2d-5d788f033f8d\") "
Oct 30 20:56:57.021539 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.020835    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume" pod "0122e012-b737-4de4-bc2d-5d788f033f8d" (UID: "0122e012-b737-4de4-bc2d-5d788f033f8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:57.021539 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.021502    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122e012-b737-4de4-bc2d-5d788f033f8d-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.025946 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.025898    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck" pod "0122e012-b737-4de4-bc2d-5d788f033f8d" (UID: "0122e012-b737-4de4-bc2d-5d788f033f8d"). InnerVolumeSpecName "kube-api-access-mxsck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:57.122679 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.122647    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\" (UniqueName: \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\") pod \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") "
Oct 30 20:56:57.122862 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.122715    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\") pod \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\" (UID: \"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d\") "
Oct 30 20:56:57.123158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.123131    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume" pod "c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" (UID: "c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:57.123341 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.123326    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.123390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.123344    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxsck\" (UniqueName: \"kubernetes.io/projected/0122e012-b737-4de4-bc2d-5d788f033f8d-kube-api-access-mxsck\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.124968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.124952    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r" pod "c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" (UID: "c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d"). InnerVolumeSpecName "kube-api-access-v489r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:57.224371 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.224299    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v489r\" (UniqueName: \"kubernetes.io/projected/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d-kube-api-access-v489r\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.453853 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.453817    5446 generic.go:356] "Generic (PLEG): container finished" podID="0122e012-b737-4de4-bc2d-5d788f033f8d" containerID="2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444" exitCode=0
Oct 30 20:56:57.454009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.453865    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"
Oct 30 20:56:57.454009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.453902    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" event={"ID":"0122e012-b737-4de4-bc2d-5d788f033f8d","Type":"ContainerDied","Data":"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"}
Oct 30 20:56:57.454009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.453971    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2" event={"ID":"0122e012-b737-4de4-bc2d-5d788f033f8d","Type":"ContainerDied","Data":"db18a578a1693eb3483c665b187b706388ec49f26eb0ebbe3bd62db33e32e11d"}
Oct 30 20:56:57.454009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.453995    5446 scope.go:122] "RemoveContainer" containerID="2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"
Oct 30 20:56:57.455502 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.455480    5446 generic.go:356] "Generic (PLEG): container finished" podID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" containerID="62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673" exitCode=0
Oct 30 20:56:57.455629 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.455524    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"
Oct 30 20:56:57.455629 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.455529    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" event={"ID":"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d","Type":"ContainerDied","Data":"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"}
Oct 30 20:56:57.455629 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.455566    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp" event={"ID":"c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d","Type":"ContainerDied","Data":"e7d05d66c5f288a1205db8259cefa6e3a4e13c453e4902cc19a8f0e916259aaa"}
Oct 30 20:56:57.464606 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.464587    5446 scope.go:122] "RemoveContainer" containerID="2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"
Oct 30 20:56:57.464951 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:57.464906    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444\": container with ID starting with 2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444 not found: ID does not exist" containerID="2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"
Oct 30 20:56:57.465024 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.464957    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444"} err="failed to get container status \"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444\": rpc error: code = NotFound desc = could not find container \"2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444\": container with ID starting with 2d9cc6b99cda22d232918edeef27cff2e33b3519072c266a2e69a713e5401444 not found: ID does not exist"
Oct 30 20:56:57.465024 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.464984    5446 scope.go:122] "RemoveContainer" containerID="62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"
Oct 30 20:56:57.474900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.474881    5446 scope.go:122] "RemoveContainer" containerID="62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"
Oct 30 20:56:57.475186 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:56:57.475168    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673\": container with ID starting with 62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673 not found: ID does not exist" containerID="62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"
Oct 30 20:56:57.475237 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.475193    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673"} err="failed to get container status \"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673\": rpc error: code = NotFound desc = could not find container \"62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673\": container with ID starting with 62ad23e46656e646c58695b0c12ef1dfbff454205d3550acb2d4662009fd7673 not found: ID does not exist"
Oct 30 20:56:57.623503 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.623473    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:56:57.630642 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.630612    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w5-0702ff-568c9ddb4-hxqp2"]
Oct 30 20:56:57.739524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.739466    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:56:57.744729 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:57.744705    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-0702ff-6c9d7b9dcf-nj6zp"]
Oct 30 20:56:58.122097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:58.122068    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0122e012-b737-4de4-bc2d-5d788f033f8d" path="/var/lib/kubelet/pods/0122e012-b737-4de4-bc2d-5d788f033f8d/volumes"
Oct 30 20:56:58.122527 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:56:58.122513    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" path="/var/lib/kubelet/pods/c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d/volumes"
Oct 30 20:57:03.638360 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:03.638325    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:57:03.638785 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:03.638653    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy" containerID="cri-o://3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204" gracePeriod=30
Oct 30 20:57:03.687748 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:03.687711    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:57:03.688034 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:03.687986    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" containerID="cri-o://11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61" gracePeriod=30
Oct 30 20:57:04.252428 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:04.252276    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:57:04.252678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:04.252585    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" containerID="cri-o://5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0" gracePeriod=30
Oct 30 20:57:04.335298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:04.335269    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:57:04.335498 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:04.335479    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy" containerID="cri-o://84e4456ef5d86851fd44de0e982e0cc6747c1703bbf0da3630d7edc52395d218" gracePeriod=30
Oct 30 20:57:07.100175 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:07.100141    5446 patch_prober.go:29] interesting pod/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:07.100565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:07.100210    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:08.879653 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:08.879619    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:08.880148 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:08.879696    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:08.968781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:08.968757    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:57:08.993482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:08.993457    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:57:09.097101 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097073    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097111    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.097223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097161    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097194    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.097374 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097222    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097374 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097332    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097374    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097479 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097426    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.097585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097478    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.097585 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097486    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:09.097696 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097616    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.097696 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097634    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.097777 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097705    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.097821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097778    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097876 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097814    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097894    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.097971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097953    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.098082 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.097991    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.098082 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098030    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.098191 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098083    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.098191 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098123    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:09.098191 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098184    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\") pod \"d9b778a8-028f-4b00-aba1-50df14c8f738\" (UID: \"d9b778a8-028f-4b00-aba1-50df14c8f738\") "
Oct 30 20:57:09.098343 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098213    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\") pod \"892fb78f-70d5-4b96-bb8e-101009d50b9b\" (UID: \"892fb78f-70d5-4b96-bb8e-101009d50b9b\") "
Oct 30 20:57:09.098405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098334    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.098405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098367    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.098514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098400    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.098601 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098567    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.098692    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099184    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099207    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099223    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099237    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099251    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099267    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/892fb78f-70d5-4b96-bb8e-101009d50b9b-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099281    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099296    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099310    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.099609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.099324    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b778a8-028f-4b00-aba1-50df14c8f738-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.100341 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.100165    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.100405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.100345    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.100519 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.100487    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.100843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.100826    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:09.101185 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.101165    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk" pod "892fb78f-70d5-4b96-bb8e-101009d50b9b" (UID: "892fb78f-70d5-4b96-bb8e-101009d50b9b"). InnerVolumeSpecName "kube-api-access-xp8zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.101316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.101301    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.101391 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.101378    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:09.101766 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.101746    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k" pod "d9b778a8-028f-4b00-aba1-50df14c8f738" (UID: "d9b778a8-028f-4b00-aba1-50df14c8f738"). InnerVolumeSpecName "kube-api-access-dhd4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201220    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201248    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201259    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhd4k\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-kube-api-access-dhd4k\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201270    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp8zk\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-kube-api-access-xp8zk\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201279    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201290    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201299    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/892fb78f-70d5-4b96-bb8e-101009d50b9b-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.201635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.201308    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b778a8-028f-4b00-aba1-50df14c8f738-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.580327 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.580300    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:57:09.581316 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.581287    5446 generic.go:356] "Generic (PLEG): container finished" podID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerID="11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61" exitCode=0
Oct 30 20:57:09.581504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.581378    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" event={"ID":"d9b778a8-028f-4b00-aba1-50df14c8f738","Type":"ContainerDied","Data":"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"}
Oct 30 20:57:09.581504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.581369    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"
Oct 30 20:57:09.581504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.581450    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v" event={"ID":"d9b778a8-028f-4b00-aba1-50df14c8f738","Type":"ContainerDied","Data":"4d8fa23048dca5299eaf5ba55a2fcf16d9eb7dffcdfa8dd6ac21690a1347a5ac"}
Oct 30 20:57:09.581651 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.581606    5446 scope.go:122] "RemoveContainer" containerID="11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"
Oct 30 20:57:09.583019 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.582984    5446 generic.go:356] "Generic (PLEG): container finished" podID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerID="3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204" exitCode=0
Oct 30 20:57:09.583106 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.583073    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"
Oct 30 20:57:09.583167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.583142    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" event={"ID":"892fb78f-70d5-4b96-bb8e-101009d50b9b","Type":"ContainerDied","Data":"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"}
Oct 30 20:57:09.583236 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.583182    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth" event={"ID":"892fb78f-70d5-4b96-bb8e-101009d50b9b","Type":"ContainerDied","Data":"c04e047cf5b60b1f086c10dfe42c4fd11602d1c1b8d89ee3ecdbddcb0a307fcb"}
Oct 30 20:57:09.586040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.586013    5446 generic.go:356] "Generic (PLEG): container finished" podID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerID="84e4456ef5d86851fd44de0e982e0cc6747c1703bbf0da3630d7edc52395d218" exitCode=0
Oct 30 20:57:09.586197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.586178    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" event={"ID":"0901e870-2a60-4ad1-b78a-21b1514022b1","Type":"ContainerDied","Data":"84e4456ef5d86851fd44de0e982e0cc6747c1703bbf0da3630d7edc52395d218"}
Oct 30 20:57:09.588959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.588131    5446 generic.go:356] "Generic (PLEG): container finished" podID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerID="5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0" exitCode=0
Oct 30 20:57:09.588959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.588190    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"
Oct 30 20:57:09.588959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.588193    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" event={"ID":"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5","Type":"ContainerDied","Data":"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"}
Oct 30 20:57:09.588959 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.588387    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk" event={"ID":"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5","Type":"ContainerDied","Data":"010726fbf67c46fa2a68f6942093697cd28c12b94328c97254928142872afde6"}
Oct 30 20:57:09.595097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.595017    5446 scope.go:122] "RemoveContainer" containerID="11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"
Oct 30 20:57:09.595416 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:09.595397    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61\": container with ID starting with 11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61 not found: ID does not exist" containerID="11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"
Oct 30 20:57:09.595536 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.595429    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61"} err="failed to get container status \"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61\": rpc error: code = NotFound desc = could not find container \"11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61\": container with ID starting with 11baa7cef10e3138a8ae1b03e83fc85053955c850fdbd6bcac2c3268843f7c61 not found: ID does not exist"
Oct 30 20:57:09.595536 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.595453    5446 scope.go:122] "RemoveContainer" containerID="3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"
Oct 30 20:57:09.611795 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.611773    5446 scope.go:122] "RemoveContainer" containerID="3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"
Oct 30 20:57:09.612207 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:09.612176    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204\": container with ID starting with 3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204 not found: ID does not exist" containerID="3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"
Oct 30 20:57:09.612301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.612215    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204"} err="failed to get container status \"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204\": rpc error: code = NotFound desc = could not find container \"3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204\": container with ID starting with 3266750aecb03123ca6da2b9b9d3c0511d313427abf96c9869d5046ac79d6204 not found: ID does not exist"
Oct 30 20:57:09.612301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.612237    5446 scope.go:122] "RemoveContainer" containerID="5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"
Oct 30 20:57:09.625186 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.624859    5446 scope.go:122] "RemoveContainer" containerID="5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"
Oct 30 20:57:09.625273 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:09.625211    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0\": container with ID starting with 5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0 not found: ID does not exist" containerID="5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"
Oct 30 20:57:09.625273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.625247    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0"} err="failed to get container status \"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0\": rpc error: code = NotFound desc = could not find container \"5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0\": container with ID starting with 5f79f015c93209cb40265c6518aee1e12472bb274e20542176ff0289e9270cb0 not found: ID does not exist"
Oct 30 20:57:09.646332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.646310    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:57:09.710678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710609    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.710678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710658    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.710877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710681    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.710877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710721    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.710877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710793    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.710877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710821    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.710877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710864    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.711159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.710949    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.711159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711030    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.711159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711068    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:09.711159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711083    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711159 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711153    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711166    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.711405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711215    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.711405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711283    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711405 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711341    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711431    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711469    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.711612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711514    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.711612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711608    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\") pod \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\" (UID: \"0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5\") "
Oct 30 20:57:09.711980 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.711650    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\") pod \"0901e870-2a60-4ad1-b78a-21b1514022b1\" (UID: \"0901e870-2a60-4ad1-b78a-21b1514022b1\") "
Oct 30 20:57:09.712067 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.712026    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.712505 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.712477    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.712607 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.712550    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:09.712699 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.712679    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.712892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.712869    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.713117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.713093    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.713299 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.713279    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.713943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.713895    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.714289 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714261    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714293    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714310    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714328    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714344    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714360    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714375    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714390    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714404    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0901e870-2a60-4ad1-b78a-21b1514022b1-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714420    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714437    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.714847 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.714783    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:09.715869 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.715843    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.716346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.716318    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:09.716465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.716445    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.716998 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.716973    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k" pod "0901e870-2a60-4ad1-b78a-21b1514022b1" (UID: "0901e870-2a60-4ad1-b78a-21b1514022b1"). InnerVolumeSpecName "kube-api-access-psl9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.717525 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.717502    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "kube-api-access-7gj4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:09.718203 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.718180    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo" pod "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" (UID: "0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:09.815814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815784    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.815814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815811    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.815814 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815821    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psl9k\" (UniqueName: \"kubernetes.io/projected/0901e870-2a60-4ad1-b78a-21b1514022b1-kube-api-access-psl9k\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.816069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815830    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.816069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815838    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0901e870-2a60-4ad1-b78a-21b1514022b1-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.816069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815846    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gj4r\" (UniqueName: \"kubernetes.io/projected/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-kube-api-access-7gj4r\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.816069 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.815854    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:09.990956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.990909    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:57:09.993575 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:09.993553    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-nzpth"]
Oct 30 20:57:10.101383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.101358    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:57:10.106649 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.106629    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-qd78v"]
Oct 30 20:57:10.120364 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.120337    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" path="/var/lib/kubelet/pods/892fb78f-70d5-4b96-bb8e-101009d50b9b/volumes"
Oct 30 20:57:10.121062 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.121006    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" path="/var/lib/kubelet/pods/d9b778a8-028f-4b00-aba1-50df14c8f738/volumes"
Oct 30 20:57:10.217524 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.217495    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:57:10.223174 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.223150    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-dvrpk"]
Oct 30 20:57:10.597332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.597304    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"
Oct 30 20:57:10.597518 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.597335    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl" event={"ID":"0901e870-2a60-4ad1-b78a-21b1514022b1","Type":"ContainerDied","Data":"3d4b0a6eb49dbc27881604c04b6be187e502207804b5f224447e761a28ca259c"}
Oct 30 20:57:10.597518 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.597397    5446 scope.go:122] "RemoveContainer" containerID="84e4456ef5d86851fd44de0e982e0cc6747c1703bbf0da3630d7edc52395d218"
Oct 30 20:57:10.765656 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.765614    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:57:10.772077 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:10.772050    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-tvsnl"]
Oct 30 20:57:12.121465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:12.121436    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" path="/var/lib/kubelet/pods/0901e870-2a60-4ad1-b78a-21b1514022b1/volumes"
Oct 30 20:57:12.121968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:12.121952    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" path="/var/lib/kubelet/pods/0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5/volumes"
Oct 30 20:57:17.311408 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:17.311373    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:57:17.428096 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:17.428062    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:57:19.515666 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:19.515632    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:57:22.312131 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.312045    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" podUID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" containerName="payload-processing" containerID="cri-o://7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20" gracePeriod=25
Oct 30 20:57:22.429390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.429362    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" podUID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" containerName="payload-pre-processing" containerID="cri-o://67080c18a27749c21d1424ab33fbf77143593ed3ac930b92ff1f68a5cadb20d6" gracePeriod=25
Oct 30 20:57:22.603157 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.603132    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:57:22.682645 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.682616    5446 generic.go:356] "Generic (PLEG): container finished" podID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" containerID="67080c18a27749c21d1424ab33fbf77143593ed3ac930b92ff1f68a5cadb20d6" exitCode=0
Oct 30 20:57:22.682808 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.682690    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" event={"ID":"7d2e98d9-d75c-4a93-ada5-d935c7e2274b","Type":"ContainerDied","Data":"67080c18a27749c21d1424ab33fbf77143593ed3ac930b92ff1f68a5cadb20d6"}
Oct 30 20:57:22.684324 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.684294    5446 generic.go:356] "Generic (PLEG): container finished" podID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" containerID="7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20" exitCode=0
Oct 30 20:57:22.684458 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.684339    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"
Oct 30 20:57:22.684458 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.684372    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" event={"ID":"6a3ebc52-6f4e-4cfe-aa56-a36da956811c","Type":"ContainerDied","Data":"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"}
Oct 30 20:57:22.684458 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.684433    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5" event={"ID":"6a3ebc52-6f4e-4cfe-aa56-a36da956811c","Type":"ContainerDied","Data":"6a71f219053bb8c7b577912d28f1e7c35ec41da153e80bbcad58912da8c52818"}
Oct 30 20:57:22.684635 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.684463    5446 scope.go:122] "RemoveContainer" containerID="7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"
Oct 30 20:57:22.696256 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.696238    5446 scope.go:122] "RemoveContainer" containerID="7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"
Oct 30 20:57:22.696563 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:22.696546    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20\": container with ID starting with 7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20 not found: ID does not exist" containerID="7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"
Oct 30 20:57:22.696612 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.696573    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20"} err="failed to get container status \"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20\": rpc error: code = NotFound desc = could not find container \"7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20\": container with ID starting with 7ab4e5d07ff4a5169fcdb8aeaca82bc310711c92c0c177a8c0c9dcc70a908a20 not found: ID does not exist"
Oct 30 20:57:22.713091 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.713074    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:57:22.785474 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.785449    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\") pod \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") "
Oct 30 20:57:22.785601 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.785561    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\" (UniqueName: \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\") pod \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\" (UID: \"6a3ebc52-6f4e-4cfe-aa56-a36da956811c\") "
Oct 30 20:57:22.785848 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.785822    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume" pod "6a3ebc52-6f4e-4cfe-aa56-a36da956811c" (UID: "6a3ebc52-6f4e-4cfe-aa56-a36da956811c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:22.786084 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.786069    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:22.787706 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.787687    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc" pod "6a3ebc52-6f4e-4cfe-aa56-a36da956811c" (UID: "6a3ebc52-6f4e-4cfe-aa56-a36da956811c"). InnerVolumeSpecName "kube-api-access-z8pmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:22.886442 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.886414    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\") pod \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") "
Oct 30 20:57:22.886673 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.886653    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\" (UniqueName: \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\") pod \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\" (UID: \"7d2e98d9-d75c-4a93-ada5-d935c7e2274b\") "
Oct 30 20:57:22.886816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.886791    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume" pod "7d2e98d9-d75c-4a93-ada5-d935c7e2274b" (UID: "7d2e98d9-d75c-4a93-ada5-d935c7e2274b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:22.887156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.887136    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:22.887244 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.887159    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8pmc\" (UniqueName: \"kubernetes.io/projected/6a3ebc52-6f4e-4cfe-aa56-a36da956811c-kube-api-access-z8pmc\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:22.889236 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.889215    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw" pod "7d2e98d9-d75c-4a93-ada5-d935c7e2274b" (UID: "7d2e98d9-d75c-4a93-ada5-d935c7e2274b"). InnerVolumeSpecName "kube-api-access-s6pkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:22.988401 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:22.988374    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6pkw\" (UniqueName: \"kubernetes.io/projected/7d2e98d9-d75c-4a93-ada5-d935c7e2274b-kube-api-access-s6pkw\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:23.108332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.108295    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:57:23.113446 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.113421    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0c83a089-68f94b844-q6cq5"]
Oct 30 20:57:23.692515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.692485    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"
Oct 30 20:57:23.692515 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.692501    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426" event={"ID":"7d2e98d9-d75c-4a93-ada5-d935c7e2274b","Type":"ContainerDied","Data":"5bcd4be1dffa70ef2f93794d4b6f79e2246ece2a455c5dca5dcb23c2d7200fb6"}
Oct 30 20:57:23.693046 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.692559    5446 scope.go:122] "RemoveContainer" containerID="67080c18a27749c21d1424ab33fbf77143593ed3ac930b92ff1f68a5cadb20d6"
Oct 30 20:57:23.858048 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.858015    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:57:23.907047 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:23.907013    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0c83a089-6bc9dc79b7-5l426"]
Oct 30 20:57:24.120317 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:24.120291    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" path="/var/lib/kubelet/pods/6a3ebc52-6f4e-4cfe-aa56-a36da956811c/volumes"
Oct 30 20:57:24.120685 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:24.120673    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" path="/var/lib/kubelet/pods/7d2e98d9-d75c-4a93-ada5-d935c7e2274b/volumes"
Oct 30 20:57:35.149348 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:35.149317    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:57:35.149727 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:35.149511    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" containerID="cri-o://46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d" gracePeriod=30
Oct 30 20:57:39.962971 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:39.962937    5446 patch_prober.go:29] interesting pod/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:57:39.963414 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:39.962996    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:57:40.410025 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.410000    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:57:40.511565 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511532    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.511705 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511661    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.511772 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511716    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.511772 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511758    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.511875 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511854    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.511982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511884    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:40.511982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.511910    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.512111 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512013    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.512111 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512086    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.512210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512136    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\") pod \"d3965dfb-d4a9-4fa9-ac03-576231952570\" (UID: \"d3965dfb-d4a9-4fa9-ac03-576231952570\") "
Oct 30 20:57:40.512210 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512171    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:40.512328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512282    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:40.512458 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512400    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:40.512545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512531    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:40.512964 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512943    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.513060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512971    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.513060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.512988    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3965dfb-d4a9-4fa9-ac03-576231952570-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.513060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.513021    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.513060 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.513036    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.514295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.514262    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:40.514395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.514297    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "kube-api-access-kbk62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:40.514395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.514354    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:57:40.514395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.514354    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo" pod "d3965dfb-d4a9-4fa9-ac03-576231952570" (UID: "d3965dfb-d4a9-4fa9-ac03-576231952570"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:57:40.614756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.614719    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.614756 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.614755    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.615048 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.614770    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbk62\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-kube-api-access-kbk62\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.615048 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.614784    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3965dfb-d4a9-4fa9-ac03-576231952570-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:40.799465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.799379    5446 generic.go:356] "Generic (PLEG): container finished" podID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerID="46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d" exitCode=0
Oct 30 20:57:40.799465 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.799431    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"
Oct 30 20:57:40.799678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.799461    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" event={"ID":"d3965dfb-d4a9-4fa9-ac03-576231952570","Type":"ContainerDied","Data":"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"}
Oct 30 20:57:40.799678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.799520    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s" event={"ID":"d3965dfb-d4a9-4fa9-ac03-576231952570","Type":"ContainerDied","Data":"a98b7fae89b8c139cdc36cec9aee8bb9480561ec3e93d65cd028f6fff04921df"}
Oct 30 20:57:40.799678 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.799545    5446 scope.go:122] "RemoveContainer" containerID="46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"
Oct 30 20:57:40.810248 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.810228    5446 scope.go:122] "RemoveContainer" containerID="46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"
Oct 30 20:57:40.810520 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:40.810499    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d\": container with ID starting with 46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d not found: ID does not exist" containerID="46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"
Oct 30 20:57:40.810570 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.810530    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d"} err="failed to get container status \"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d\": rpc error: code = NotFound desc = could not find container \"46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d\": container with ID starting with 46e23f3ffe4487f82517da049ba9642f9644b6d3ebf4293a9afbed8b0741f55d not found: ID does not exist"
Oct 30 20:57:40.965301 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:40.965269    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:57:41.014226 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:41.014181    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-0702ff-openshift-default-5d6966c459-tbh2s"]
Oct 30 20:57:42.123344 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:42.123314    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" path="/var/lib/kubelet/pods/d3965dfb-d4a9-4fa9-ac03-576231952570/volumes"
Oct 30 20:57:49.517443 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:57:49.517405    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:57:57.797892 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:57:57.797856    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:58:12.820442 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:12.820384    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main" containerID="cri-o://34123fd878354b764a1cd3aeadacaaaab067f2d22fa3c91a015d3d8a167423d7" gracePeriod=45
Oct 30 20:58:13.031528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.031367    5446 generic.go:356] "Generic (PLEG): container finished" podID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerID="34123fd878354b764a1cd3aeadacaaaab067f2d22fa3c91a015d3d8a167423d7" exitCode=0
Oct 30 20:58:13.031528 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.031486    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" event={"ID":"539ff7e3-3945-4bad-a255-f8a287eb6e41","Type":"ContainerDied","Data":"34123fd878354b764a1cd3aeadacaaaab067f2d22fa3c91a015d3d8a167423d7"}
Oct 30 20:58:13.092167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.092146    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:58:13.256980 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.256952    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257040    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257158 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257098    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257196    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257194    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:13.257284 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257240    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\" (UniqueName: \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257444 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257314    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:13.257444 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257383    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\" (UniqueName: \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\") pod \"539ff7e3-3945-4bad-a255-f8a287eb6e41\" (UID: \"539ff7e3-3945-4bad-a255-f8a287eb6e41\") "
Oct 30 20:58:13.257559 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.257464    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:13.258065 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.258043    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.258065 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.258066    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.258272 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.258080    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.259596 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.259576    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:13.259704 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.259613    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:13.259816 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.259797    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f" pod "539ff7e3-3945-4bad-a255-f8a287eb6e41" (UID: "539ff7e3-3945-4bad-a255-f8a287eb6e41"). InnerVolumeSpecName "kube-api-access-qwz2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:13.359326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.359258    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwz2f\" (UniqueName: \"kubernetes.io/projected/539ff7e3-3945-4bad-a255-f8a287eb6e41-kube-api-access-qwz2f\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.359326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.359284    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539ff7e3-3945-4bad-a255-f8a287eb6e41-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:13.359326 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:13.359297    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539ff7e3-3945-4bad-a255-f8a287eb6e41-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:14.038617 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:14.038578    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8" event={"ID":"539ff7e3-3945-4bad-a255-f8a287eb6e41","Type":"ContainerDied","Data":"03cd50240690f8efbefcbc1c9b81dc1e4c0e7211a4d1aeb8da8a656e824be63f"}
Oct 30 20:58:14.039122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:14.038635    5446 scope.go:122] "RemoveContainer" containerID="34123fd878354b764a1cd3aeadacaaaab067f2d22fa3c91a015d3d8a167423d7"
Oct 30 20:58:14.039122 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:14.038792    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"
Oct 30 20:58:14.214949 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:14.214882    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:58:14.263489 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:14.263465    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-f6ebf5/distinct-w3-f6ebf5-kserve-58cc49887b-l7mh8"]
Oct 30 20:58:15.134285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:15.134258    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:58:15.134703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:15.134434    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy" containerID="cri-o://a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7" gracePeriod=30
Oct 30 20:58:16.120402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:16.120368    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" path="/var/lib/kubelet/pods/539ff7e3-3945-4bad-a255-f8a287eb6e41/volumes"
Oct 30 20:58:19.517280 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:19.517242    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:58:20.395014 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.394987    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:58:20.449452 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449397    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449452 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449430    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449597 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449508    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449650 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449619    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449673    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:20.449703 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449685    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449726    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449776    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449777    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:20.449943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449793    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.449943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449862    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:20.449943 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.449904    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\") pod \"11971513-145a-4013-917d-e2addc37ffd1\" (UID: \"11971513-145a-4013-917d-e2addc37ffd1\") "
Oct 30 20:58:20.450354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450236    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:20.450354 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450263    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:20.450643 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450617    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11971513-145a-4013-917d-e2addc37ffd1-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.450825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450646    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.450825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450662    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.450825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450676    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.450825 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.450690    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.452055 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.452030    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:58:20.452168 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.452047    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:20.452168 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.452113    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:20.452246 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.452209    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7" pod "11971513-145a-4013-917d-e2addc37ffd1" (UID: "11971513-145a-4013-917d-e2addc37ffd1"). InnerVolumeSpecName "kube-api-access-lhwf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:20.552212 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.552190    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.552506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.552219    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhwf7\" (UniqueName: \"kubernetes.io/projected/11971513-145a-4013-917d-e2addc37ffd1-kube-api-access-lhwf7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.552506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.552235    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11971513-145a-4013-917d-e2addc37ffd1-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.552506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.552251    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11971513-145a-4013-917d-e2addc37ffd1-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:20.616055 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.616024    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:58:20.618268 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:20.618243    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:58:21.081714 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.081683    5446 generic.go:356] "Generic (PLEG): container finished" podID="11971513-145a-4013-917d-e2addc37ffd1" containerID="a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7" exitCode=0
Oct 30 20:58:21.081895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.081736    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"
Oct 30 20:58:21.081895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.081769    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerDied","Data":"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"}
Oct 30 20:58:21.081895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.081830    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh" event={"ID":"11971513-145a-4013-917d-e2addc37ffd1","Type":"ContainerDied","Data":"e2c26873eae1c5c7e58eab88f207cee3090438fb35fbd156fcf099c7b89f214b"}
Oct 30 20:58:21.081895 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.081859    5446 scope.go:122] "RemoveContainer" containerID="a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"
Oct 30 20:58:21.093097 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.093072    5446 scope.go:122] "RemoveContainer" containerID="485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"
Oct 30 20:58:21.102438 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.102421    5446 scope.go:122] "RemoveContainer" containerID="a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"
Oct 30 20:58:21.102713 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:21.102695    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7\": container with ID starting with a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7 not found: ID does not exist" containerID="a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"
Oct 30 20:58:21.102761 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.102723    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7"} err="failed to get container status \"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7\": rpc error: code = NotFound desc = could not find container \"a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7\": container with ID starting with a9e75b4de37ddaccf6a1ff37d8e72f3b8b553dbbdae30d54677729f07fa6fce7 not found: ID does not exist"
Oct 30 20:58:21.102761 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.102746    5446 scope.go:122] "RemoveContainer" containerID="485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"
Oct 30 20:58:21.102979 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:21.102963    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea\": container with ID starting with 485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea not found: ID does not exist" containerID="485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"
Oct 30 20:58:21.103039 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.102984    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea"} err="failed to get container status \"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea\": rpc error: code = NotFound desc = could not find container \"485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea\": container with ID starting with 485d860ca3df2488da8b9c41f48314468348cc7c7b575544118ec4785ec685ea not found: ID does not exist"
Oct 30 20:58:21.249195 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.249169    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:58:21.257259 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:21.257239    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aaf669-openshift-default-64ff47dcf9-r4qdh"]
Oct 30 20:58:22.119040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:22.119008    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11971513-145a-4013-917d-e2addc37ffd1" path="/var/lib/kubelet/pods/11971513-145a-4013-917d-e2addc37ffd1/volumes"
Oct 30 20:58:35.637038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:35.636984    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main" containerID="cri-o://05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7" gracePeriod=45
Oct 30 20:58:35.638321 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:35.638287    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main" containerID="cri-o://b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced" gracePeriod=45
Oct 30 20:58:35.927467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:35.927432    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:58:35.942150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:35.942127    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:58:36.054365 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054329    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.054553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054384    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\" (UniqueName: \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.054553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054446    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.054553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054482    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.054553 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054511    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.054801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054584    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\" (UniqueName: \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.054801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054641    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.054801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054707    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\" (UniqueName: \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.054801 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054765    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\") pod \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\" (UID: \"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b\") "
Oct 30 20:58:36.055035 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.054827    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\" (UniqueName: \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.055878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.055595    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.055878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.055801    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.055878 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.055815    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.056204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.056024    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.056204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.056104    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.056204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.056139    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\") pod \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\" (UID: \"0858ca5e-a17c-4a04-890f-7f2b35dfe52e\") "
Oct 30 20:58:36.056395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.056369    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.056760 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.056735    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.057054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057031    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057059    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057076    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057090    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057104    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057138 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057118    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.057786 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.057762    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.058654 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.058622    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "kube-api-access-b492l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:36.058654 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.058634    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:58:36.058813 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.058666    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs" pod "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" (UID: "b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.058871 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.058817    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "kube-api-access-4c7p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:36.060119 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.060093    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs" pod "0858ca5e-a17c-4a04-890f-7f2b35dfe52e" (UID: "0858ca5e-a17c-4a04-890f-7f2b35dfe52e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.158641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158575    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.158641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158612    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.158641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158631    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c7p9\" (UniqueName: \"kubernetes.io/projected/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-kube-api-access-4c7p9\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.158885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158647    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0858ca5e-a17c-4a04-890f-7f2b35dfe52e-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.158885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158662    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b492l\" (UniqueName: \"kubernetes.io/projected/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-kube-api-access-b492l\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.158885 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.158678    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.204976 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.204895    5446 generic.go:356] "Generic (PLEG): container finished" podID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerID="b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced" exitCode=0
Oct 30 20:58:36.205133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.205003    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"
Oct 30 20:58:36.205133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.205051    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" event={"ID":"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b","Type":"ContainerDied","Data":"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"}
Oct 30 20:58:36.205133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.205085    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw" event={"ID":"b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b","Type":"ContainerDied","Data":"d265e0b231df944d9ac0698f42d876cb7c6cd48ae26dc1a1309e3d404e88e5f3"}
Oct 30 20:58:36.205133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.205106    5446 scope.go:122] "RemoveContainer" containerID="b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"
Oct 30 20:58:36.207204 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.207172    5446 generic.go:356] "Generic (PLEG): container finished" podID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerID="05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7" exitCode=0
Oct 30 20:58:36.207336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.207208    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"
Oct 30 20:58:36.207336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.207227    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" event={"ID":"0858ca5e-a17c-4a04-890f-7f2b35dfe52e","Type":"ContainerDied","Data":"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"}
Oct 30 20:58:36.207336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.207263    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt" event={"ID":"0858ca5e-a17c-4a04-890f-7f2b35dfe52e","Type":"ContainerDied","Data":"2fa46e1aa99f080fe15e7356230c8fccfb0158e363251d27ed5145c8aa13f6f3"}
Oct 30 20:58:36.215216 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.215194    5446 scope.go:122] "RemoveContainer" containerID="b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"
Oct 30 20:58:36.215516 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:36.215492    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced\": container with ID starting with b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced not found: ID does not exist" containerID="b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"
Oct 30 20:58:36.215609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.215521    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced"} err="failed to get container status \"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced\": rpc error: code = NotFound desc = could not find container \"b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced\": container with ID starting with b8852c59b795d8f9dba47056a09bfc604e9b85e7b44a8523628f739441158ced not found: ID does not exist"
Oct 30 20:58:36.215609 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.215540    5446 scope.go:122] "RemoveContainer" containerID="05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"
Oct 30 20:58:36.224836 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.224816    5446 scope.go:122] "RemoveContainer" containerID="05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"
Oct 30 20:58:36.225153 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:36.225121    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7\": container with ID starting with 05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7 not found: ID does not exist" containerID="05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"
Oct 30 20:58:36.225232 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.225159    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7"} err="failed to get container status \"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7\": rpc error: code = NotFound desc = could not find container \"05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7\": container with ID starting with 05206b3793215d5fed0d60b805be56d7a5c721a89d66b4e1615bd44006d889e7 not found: ID does not exist"
Oct 30 20:58:36.371788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.371758    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:58:36.376632 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.376608    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/premium-w2-b43c84-kserve-587f4595b-jhdjt"]
Oct 30 20:58:36.489778 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.489718    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:58:36.495117 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:36.495094    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b43c84/simulator-w2-b43c84-kserve-6d77fb4c89-hl2lw"]
Oct 30 20:58:38.120745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:38.120707    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" path="/var/lib/kubelet/pods/0858ca5e-a17c-4a04-890f-7f2b35dfe52e/volumes"
Oct 30 20:58:38.121720 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:38.121295    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" path="/var/lib/kubelet/pods/b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b/volumes"
Oct 30 20:58:49.516663 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:58:49.516627    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:58:54.613383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:58:54.613298    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:59:09.635296 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.635240    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main" containerID="cri-o://07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a" gracePeriod=45
Oct 30 20:59:09.892290 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.892233    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:59:09.997144 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.997112    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:59:09.997390 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.997352    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy" containerID="cri-o://4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19" gracePeriod=30
Oct 30 20:59:09.999727 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.999701    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:59:09.999901 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:09.999877    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy" containerID="cri-o://2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed" gracePeriod=30
Oct 30 20:59:10.014594 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014564    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\" (UniqueName: \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.014713 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014607    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.014713 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014648    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.014830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014819    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.014887 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014865    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.014993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014951    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:10.014993 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.014977    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\") pod \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\" (UID: \"ca50717d-68ff-4b38-8cc7-411c6ed4843f\") "
Oct 30 20:59:10.015136 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.015108    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:10.015219 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.015119    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:10.015767 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.015744    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.015868 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.015774    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.015868 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.015790    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.017099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.017077    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:10.017099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.017090    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "kube-api-access-4s4ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:10.017225 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.017190    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs" pod "ca50717d-68ff-4b38-8cc7-411c6ed4843f" (UID: "ca50717d-68ff-4b38-8cc7-411c6ed4843f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:10.047519 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.047495    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:59:10.047737 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.047715    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy" containerID="cri-o://d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290" gracePeriod=30
Oct 30 20:59:10.117089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.117058    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca50717d-68ff-4b38-8cc7-411c6ed4843f-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.117089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.117085    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s4ks\" (UniqueName: \"kubernetes.io/projected/ca50717d-68ff-4b38-8cc7-411c6ed4843f-kube-api-access-4s4ks\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.117089 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.117097    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca50717d-68ff-4b38-8cc7-411c6ed4843f-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:10.482841 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.482801    5446 generic.go:356] "Generic (PLEG): container finished" podID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerID="07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a" exitCode=0
Oct 30 20:59:10.482841 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.482834    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"
Oct 30 20:59:10.483088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.482899    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" event={"ID":"ca50717d-68ff-4b38-8cc7-411c6ed4843f","Type":"ContainerDied","Data":"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"}
Oct 30 20:59:10.483088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.482952    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf" event={"ID":"ca50717d-68ff-4b38-8cc7-411c6ed4843f","Type":"ContainerDied","Data":"d5d4d9a0febcc5ed90cb2b05a0ea9bfc6de984bf2b5c05066ca3f561106a893b"}
Oct 30 20:59:10.483088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.482977    5446 scope.go:122] "RemoveContainer" containerID="07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"
Oct 30 20:59:10.494857 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.494827    5446 scope.go:122] "RemoveContainer" containerID="07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"
Oct 30 20:59:10.495163 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:10.495140    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a\": container with ID starting with 07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a not found: ID does not exist" containerID="07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"
Oct 30 20:59:10.495239 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.495174    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a"} err="failed to get container status \"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a\": rpc error: code = NotFound desc = could not find container \"07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a\": container with ID starting with 07b43c4bdfd451232acefdf9d250c830db3ed83b561ef08e834c0aa6f016c81a not found: ID does not exist"
Oct 30 20:59:10.648575 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.648545    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:59:10.650745 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:10.650720    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-386743/distinct-2-w5-386743-kserve-7fdc8bf846-njbqf"]
Oct 30 20:59:12.122568 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:12.122534    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" path="/var/lib/kubelet/pods/ca50717d-68ff-4b38-8cc7-411c6ed4843f/volumes"
Oct 30 20:59:12.543564 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:12.543483    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:59:12.543718 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:12.543681    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy" containerID="cri-o://85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e" gracePeriod=30
Oct 30 20:59:15.330332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.330297    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:59:15.333729 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.333706    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:59:15.373781 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.373757    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:59:15.498295 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498261    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498309    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498346    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498385    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498414    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498455    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.498510 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498502    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498529    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498556    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498584    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498621    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498655    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498697    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.498850 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.498808    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.499247 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499049    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.499304 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499283    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.499362 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499299    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.499362 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499342    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.499467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499373    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.499467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499419    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.499467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499443    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.499467 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499464    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499521    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499556    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499600    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499649    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499652    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.499689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499683    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499717    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499730    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499754    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\") pod \"a79f53f9-11f1-46eb-8b6d-12df0337f833\" (UID: \"a79f53f9-11f1-46eb-8b6d-12df0337f833\") "
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499784    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\") pod \"88f3ae25-a30c-4269-8ba3-a10640b99f49\" (UID: \"88f3ae25-a30c-4269-8ba3-a10640b99f49\") "
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499816    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\") pod \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\" (UID: \"8a8e0e11-4248-4879-b6d3-9ed77222ef84\") "
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499880    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.500009 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.499992    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:15.500659 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.500631    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:15.500877 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.500851    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.501560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.501124    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:15.501560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.501550    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.502078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.501955    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:15.502078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.501961    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.502078 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.502031    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.503066 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503037    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.503242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503202    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503242 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503232    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a79f53f9-11f1-46eb-8b6d-12df0337f833-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503250    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503269    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503284    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503297    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503309    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503323    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503336    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503349    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503362    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503375    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503383 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503387    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503401    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503415    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503430    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88f3ae25-a30c-4269-8ba3-a10640b99f49-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.503982 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.503504    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.504227 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.504196    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.504298 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.504244    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "kube-api-access-qfz6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.504568 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.504529    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.506040 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.506009    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:15.506197 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.506171    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.506533 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.506508    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:15.506768 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.506743    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy" pod "a79f53f9-11f1-46eb-8b6d-12df0337f833" (UID: "a79f53f9-11f1-46eb-8b6d-12df0337f833"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:15.506851 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.506817    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv" pod "8a8e0e11-4248-4879-b6d3-9ed77222ef84" (UID: "8a8e0e11-4248-4879-b6d3-9ed77222ef84"). InnerVolumeSpecName "kube-api-access-x9ngv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.507812 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.507789    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "kube-api-access-pxdnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.508099 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.508079    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token" pod "88f3ae25-a30c-4269-8ba3-a10640b99f49" (UID: "88f3ae25-a30c-4269-8ba3-a10640b99f49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:15.519161 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.519139    5446 generic.go:356] "Generic (PLEG): container finished" podID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerID="4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19" exitCode=0
Oct 30 20:59:15.519255 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.519201    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"
Oct 30 20:59:15.519255 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.519224    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" event={"ID":"8a8e0e11-4248-4879-b6d3-9ed77222ef84","Type":"ContainerDied","Data":"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"}
Oct 30 20:59:15.519372 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.519320    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz" event={"ID":"8a8e0e11-4248-4879-b6d3-9ed77222ef84","Type":"ContainerDied","Data":"34d744a7389b491a3dddee3580ddbf94b5e90f8423d789e0f15e045587c3a302"}
Oct 30 20:59:15.519372 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.519354    5446 scope.go:122] "RemoveContainer" containerID="4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"
Oct 30 20:59:15.520575 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.520552    5446 generic.go:356] "Generic (PLEG): container finished" podID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerID="d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290" exitCode=0
Oct 30 20:59:15.520676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.520620    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"
Oct 30 20:59:15.520676 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.520643    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" event={"ID":"88f3ae25-a30c-4269-8ba3-a10640b99f49","Type":"ContainerDied","Data":"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"}
Oct 30 20:59:15.520790 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.520701    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l" event={"ID":"88f3ae25-a30c-4269-8ba3-a10640b99f49","Type":"ContainerDied","Data":"dd4ea97650f11749dbfa82ab7cb34adbda7961c7e3cb360dfd42149c1148d5dd"}
Oct 30 20:59:15.522173 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.522153    5446 generic.go:356] "Generic (PLEG): container finished" podID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerID="2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed" exitCode=0
Oct 30 20:59:15.522275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.522195    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"
Oct 30 20:59:15.522275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.522215    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" event={"ID":"a79f53f9-11f1-46eb-8b6d-12df0337f833","Type":"ContainerDied","Data":"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"}
Oct 30 20:59:15.522275 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.522252    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv" event={"ID":"a79f53f9-11f1-46eb-8b6d-12df0337f833","Type":"ContainerDied","Data":"8c88075ecd79d0a9f6286c9b6914ca416229b052a3658235587f3e4f1d2b07da"}
Oct 30 20:59:15.532155 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.532118    5446 scope.go:122] "RemoveContainer" containerID="4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"
Oct 30 20:59:15.532695 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:15.532674    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19\": container with ID starting with 4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19 not found: ID does not exist" containerID="4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"
Oct 30 20:59:15.532788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.532707    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19"} err="failed to get container status \"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19\": rpc error: code = NotFound desc = could not find container \"4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19\": container with ID starting with 4b323233fb16f0fc66feb0ff01cae152ca3b8dd3633ecd885b854191e9a63e19 not found: ID does not exist"
Oct 30 20:59:15.532788 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.532728    5446 scope.go:122] "RemoveContainer" containerID="d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"
Oct 30 20:59:15.545378 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.545357    5446 scope.go:122] "RemoveContainer" containerID="d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"
Oct 30 20:59:15.545701 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:15.545678    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290\": container with ID starting with d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290 not found: ID does not exist" containerID="d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"
Oct 30 20:59:15.545800 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.545706    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290"} err="failed to get container status \"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290\": rpc error: code = NotFound desc = could not find container \"d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290\": container with ID starting with d5ecf2791b945f95131f0372c557c7d261f57b026258298528a743859b27e290 not found: ID does not exist"
Oct 30 20:59:15.545800 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.545723    5446 scope.go:122] "RemoveContainer" containerID="2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"
Oct 30 20:59:15.555098 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.555081    5446 scope.go:122] "RemoveContainer" containerID="2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"
Oct 30 20:59:15.555422 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:15.555398    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed\": container with ID starting with 2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed not found: ID does not exist" containerID="2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"
Oct 30 20:59:15.555497 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.555433    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed"} err="failed to get container status \"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed\": rpc error: code = NotFound desc = could not find container \"2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed\": container with ID starting with 2026a4517267beeb2c67bda72ae5cfb5784c8fac76f8035bdf2857fc90f338ed not found: ID does not exist"
Oct 30 20:59:15.604857 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604832    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.604857 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604857    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfz6z\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-kube-api-access-qfz6z\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604869    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604878    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9ngv\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-kube-api-access-x9ngv\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604886    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604895    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604904    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88f3ae25-a30c-4269-8ba3-a10640b99f49-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604926    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxdnk\" (UniqueName: \"kubernetes.io/projected/88f3ae25-a30c-4269-8ba3-a10640b99f49-kube-api-access-pxdnk\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604934    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a79f53f9-11f1-46eb-8b6d-12df0337f833-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604942    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.605038 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.604951    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a8e0e11-4248-4879-b6d3-9ed77222ef84-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:15.858282 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.858187    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:59:15.861662 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.861636    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-w8r7l"]
Oct 30 20:59:15.967830 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.967794    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:59:15.974436 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:15.974407    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-twxfz"]
Oct 30 20:59:16.085031 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:16.084996    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:59:16.090332 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:16.090309    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-vhkcv"]
Oct 30 20:59:16.122083 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:16.122058    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" path="/var/lib/kubelet/pods/88f3ae25-a30c-4269-8ba3-a10640b99f49/volumes"
Oct 30 20:59:16.122504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:16.122489    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" path="/var/lib/kubelet/pods/8a8e0e11-4248-4879-b6d3-9ed77222ef84/volumes"
Oct 30 20:59:16.123047 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:16.123024    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" path="/var/lib/kubelet/pods/a79f53f9-11f1-46eb-8b6d-12df0337f833/volumes"
Oct 30 20:59:17.817555 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.817496    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:59:17.831712 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831687    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.831821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831740    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.831821 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831807    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.831965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831839    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.831965 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831947    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.832084 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.831991    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.832084 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832043    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.832182 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832081    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.832182 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832159    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\") pod \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\" (UID: \"14ce1bb6-df76-4453-951d-daa3b4d07ce9\") "
Oct 30 20:59:17.832444 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832091    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:17.832522 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832139    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:17.832522 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832227    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:17.832522 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832264    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:17.832522 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832490    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:17.832872 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832751    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.832911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832887    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.832911 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832903    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.833029 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832936    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.833029 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.832955    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.833907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.833886    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:17.834213 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.834195    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:17.834795 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.834778    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "kube-api-access-s862x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:17.834870 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.834791    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token" pod "14ce1bb6-df76-4453-951d-daa3b4d07ce9" (UID: "14ce1bb6-df76-4453-951d-daa3b4d07ce9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:17.933726 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.933703    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s862x\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-kube-api-access-s862x\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.933726 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.933726    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.933849 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.933738    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.933849 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:17.933746    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ce1bb6-df76-4453-951d-daa3b4d07ce9-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:18.545328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.545255    5446 generic.go:356] "Generic (PLEG): container finished" podID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerID="85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e" exitCode=0
Oct 30 20:59:18.545328 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.545302    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"
Oct 30 20:59:18.545504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.545345    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerDied","Data":"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"}
Oct 30 20:59:18.545504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.545404    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw" event={"ID":"14ce1bb6-df76-4453-951d-daa3b4d07ce9","Type":"ContainerDied","Data":"259eef69874f97f0cb1036ffda3a05027d52d03b1013f60f583c38525067fd04"}
Oct 30 20:59:18.545504 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.545429    5446 scope.go:122] "RemoveContainer" containerID="85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"
Oct 30 20:59:18.554910 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.554892    5446 scope.go:122] "RemoveContainer" containerID="472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"
Oct 30 20:59:18.563838 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.563819    5446 scope.go:122] "RemoveContainer" containerID="85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"
Oct 30 20:59:18.564127 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:18.564110    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e\": container with ID starting with 85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e not found: ID does not exist" containerID="85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"
Oct 30 20:59:18.564183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.564136    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e"} err="failed to get container status \"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e\": rpc error: code = NotFound desc = could not find container \"85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e\": container with ID starting with 85cebb6095aed8d9404f47327751d00b2a7b9e5cb6def030ad5fecbd68ebd60e not found: ID does not exist"
Oct 30 20:59:18.564183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.564153    5446 scope.go:122] "RemoveContainer" containerID="472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"
Oct 30 20:59:18.564370 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:18.564358    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a\": container with ID starting with 472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a not found: ID does not exist" containerID="472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"
Oct 30 20:59:18.564411 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.564373    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a"} err="failed to get container status \"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a\": rpc error: code = NotFound desc = could not find container \"472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a\": container with ID starting with 472036e853fee191235f0f870c0295079b9bb682243a6f85302d6bd1d7a1f73a not found: ID does not exist"
Oct 30 20:59:18.765475 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.765441    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:59:18.781422 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:18.781386    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w6-3d7c11-openshift-default-674b64c445-hk5rw"]
Oct 30 20:59:19.516280 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:19.516243    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:59:20.120765 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:20.120721    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" path="/var/lib/kubelet/pods/14ce1bb6-df76-4453-951d-daa3b4d07ce9/volumes"
Oct 30 20:59:20.299769 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:20.299744    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:59:20.299984 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:20.299937    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" containerID="cri-o://9bcf13c6f473cb5fa87d7197ebec3c5e7588276cf51a8bd215bfa591f1d5412e" gracePeriod=30
Oct 30 20:59:20.351030 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:20.350988    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:59:20.351285 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:20.351230    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy" containerID="cri-o://2308ffdc6f76336ce2c38f6ab119834f7b8fb5dd2405b08a8dac749cec554840" gracePeriod=30
Oct 30 20:59:22.923826 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:22.923786    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:59:22.924274 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:22.923861    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:59:25.593234 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.593151    5446 generic.go:356] "Generic (PLEG): container finished" podID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerID="2308ffdc6f76336ce2c38f6ab119834f7b8fb5dd2405b08a8dac749cec554840" exitCode=0
Oct 30 20:59:25.593709 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.593265    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" event={"ID":"c6eaa394-a7cc-47bb-9165-d1f695059dec","Type":"ContainerDied","Data":"2308ffdc6f76336ce2c38f6ab119834f7b8fb5dd2405b08a8dac749cec554840"}
Oct 30 20:59:25.595424 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.595395    5446 generic.go:356] "Generic (PLEG): container finished" podID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerID="9bcf13c6f473cb5fa87d7197ebec3c5e7588276cf51a8bd215bfa591f1d5412e" exitCode=0
Oct 30 20:59:25.595560 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.595488    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" event={"ID":"39f9832f-07dc-4ffd-af6c-937b169f2568","Type":"ContainerDied","Data":"9bcf13c6f473cb5fa87d7197ebec3c5e7588276cf51a8bd215bfa591f1d5412e"}
Oct 30 20:59:25.684088 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.684042    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:59:25.687732 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.687709    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:59:25.825751 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825725    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.825886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825763    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.825886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825799    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.825886 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825827    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.826054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825885    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.825984    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826015    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826054 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826044    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.826265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826156    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826265 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826194    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826368 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826289    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826368 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826310    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826368 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826357    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.826514 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826388    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826519    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826571 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826544    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826744 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826716    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.826744 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826737    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826776    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.826950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826821    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.826950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826869    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.826950 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826896    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:25.827183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.826974    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.827183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827018    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\") pod \"c6eaa394-a7cc-47bb-9165-d1f695059dec\" (UID: \"c6eaa394-a7cc-47bb-9165-d1f695059dec\") "
Oct 30 20:59:25.827183 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827049    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\") pod \"39f9832f-07dc-4ffd-af6c-937b169f2568\" (UID: \"39f9832f-07dc-4ffd-af6c-937b169f2568\") "
Oct 30 20:59:25.827336 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827266    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.827623 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827597    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827630    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827645    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827659    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827672    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827686    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.827707 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827699    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f9832f-07dc-4ffd-af6c-937b169f2568-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.828068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827716    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.828068 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.827954    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.829400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829292    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.829400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829306    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:25.829400 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829376    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:25.829616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829516    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:25.829616 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829535    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:25.829729 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.829638    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:25.830037 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.830015    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "kube-api-access-tr9rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:25.830258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.830240    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo" pod "39f9832f-07dc-4ffd-af6c-937b169f2568" (UID: "39f9832f-07dc-4ffd-af6c-937b169f2568"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:25.830402 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.830385    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql" pod "c6eaa394-a7cc-47bb-9165-d1f695059dec" (UID: "c6eaa394-a7cc-47bb-9165-d1f695059dec"). InnerVolumeSpecName "kube-api-access-w7rql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:25.928688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928657    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928684    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928688 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928693    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928704    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6eaa394-a7cc-47bb-9165-d1f695059dec-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928713    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928722    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7rql\" (UniqueName: \"kubernetes.io/projected/c6eaa394-a7cc-47bb-9165-d1f695059dec-kube-api-access-w7rql\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928732    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6eaa394-a7cc-47bb-9165-d1f695059dec-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928741    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f9832f-07dc-4ffd-af6c-937b169f2568-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928750    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6eaa394-a7cc-47bb-9165-d1f695059dec-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:25.928907 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:25.928758    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr9rn\" (UniqueName: \"kubernetes.io/projected/39f9832f-07dc-4ffd-af6c-937b169f2568-kube-api-access-tr9rn\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:26.604455 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.604421    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"
Oct 30 20:59:26.605003 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.604428    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9" event={"ID":"c6eaa394-a7cc-47bb-9165-d1f695059dec","Type":"ContainerDied","Data":"3d48df71f4cdc8c151e6de8641764223321090bae91fcd66d31a4886d70fa860"}
Oct 30 20:59:26.605092 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.605074    5446 scope.go:122] "RemoveContainer" containerID="2308ffdc6f76336ce2c38f6ab119834f7b8fb5dd2405b08a8dac749cec554840"
Oct 30 20:59:26.607701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.607669    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw" event={"ID":"39f9832f-07dc-4ffd-af6c-937b169f2568","Type":"ContainerDied","Data":"8073a0bacae93ce78f80394f3f67f33f7041406e22c89bceb985a5a77daabf34"}
Oct 30 20:59:26.607845 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.607777    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"
Oct 30 20:59:26.625056 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.624857    5446 scope.go:122] "RemoveContainer" containerID="9bcf13c6f473cb5fa87d7197ebec3c5e7588276cf51a8bd215bfa591f1d5412e"
Oct 30 20:59:26.771521 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.771488    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:59:26.820644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.820615    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-6krrw"]
Oct 30 20:59:26.889689 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.889658    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:59:26.899395 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:26.899365    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-9ztt9"]
Oct 30 20:59:28.119882 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:28.119849    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" path="/var/lib/kubelet/pods/39f9832f-07dc-4ffd-af6c-937b169f2568/volumes"
Oct 30 20:59:28.120387 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:28.120372    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" path="/var/lib/kubelet/pods/c6eaa394-a7cc-47bb-9165-d1f695059dec/volumes"
Oct 30 20:59:30.881337 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:30.881299    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:59:30.881747 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:30.881519    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" podUID="fa366927-7d3c-4595-82d5-0a75bec2f384" containerName="maas-api" containerID="cri-o://06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015" gracePeriod=30
Oct 30 20:59:31.157545 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.157516    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:59:31.308698 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.308658    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") pod \"fa366927-7d3c-4595-82d5-0a75bec2f384\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") "
Oct 30 20:59:31.309079 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.309053    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\" (UniqueName: \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\") pod \"fa366927-7d3c-4595-82d5-0a75bec2f384\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") "
Oct 30 20:59:31.309843 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.309806    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\") pod \"fa366927-7d3c-4595-82d5-0a75bec2f384\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") "
Oct 30 20:59:31.309997 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.309866    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\") pod \"fa366927-7d3c-4595-82d5-0a75bec2f384\" (UID: \"fa366927-7d3c-4595-82d5-0a75bec2f384\") "
Oct 30 20:59:31.310641 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.310599    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca" pod "fa366927-7d3c-4595-82d5-0a75bec2f384" (UID: "fa366927-7d3c-4595-82d5-0a75bec2f384"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:31.325211 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.323094    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs" pod "fa366927-7d3c-4595-82d5-0a75bec2f384" (UID: "fa366927-7d3c-4595-82d5-0a75bec2f384"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:31.326103 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.326054    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f" pod "fa366927-7d3c-4595-82d5-0a75bec2f384" (UID: "fa366927-7d3c-4595-82d5-0a75bec2f384"). InnerVolumeSpecName "kube-api-access-8pl7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:31.326482 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.326446    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls" pod "fa366927-7d3c-4595-82d5-0a75bec2f384" (UID: "fa366927-7d3c-4595-82d5-0a75bec2f384"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:31.413007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.412373    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:31.413007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.412409    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pl7f\" (UniqueName: \"kubernetes.io/projected/fa366927-7d3c-4595-82d5-0a75bec2f384-kube-api-access-8pl7f\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:31.413007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.412422    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa366927-7d3c-4595-82d5-0a75bec2f384-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:31.413007 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.412435    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa366927-7d3c-4595-82d5-0a75bec2f384-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:31.640137 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.640108    5446 generic.go:356] "Generic (PLEG): container finished" podID="fa366927-7d3c-4595-82d5-0a75bec2f384" containerID="06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015" exitCode=0
Oct 30 20:59:31.640330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.640163    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"
Oct 30 20:59:31.640330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.640177    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" event={"ID":"fa366927-7d3c-4595-82d5-0a75bec2f384","Type":"ContainerDied","Data":"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"}
Oct 30 20:59:31.640330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.640223    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr" event={"ID":"fa366927-7d3c-4595-82d5-0a75bec2f384","Type":"ContainerDied","Data":"b424a557c4a9572341f3b4ab6f392691a7da00973f1c56f86ca058e900c2509f"}
Oct 30 20:59:31.640330 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.640248    5446 scope.go:122] "RemoveContainer" containerID="06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"
Oct 30 20:59:31.650140 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.650123    5446 scope.go:122] "RemoveContainer" containerID="06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"
Oct 30 20:59:31.650417 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:31.650397    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015\": container with ID starting with 06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015 not found: ID does not exist" containerID="06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"
Oct 30 20:59:31.650502 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.650429    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015"} err="failed to get container status \"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015\": rpc error: code = NotFound desc = could not find container \"06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015\": container with ID starting with 06bf4464e8e0285484e740e7f7fa2fda48b00dacd2da7fb9607a7939ce3c0015 not found: ID does not exist"
Oct 30 20:59:31.808730 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.808655    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:59:31.811503 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:31.811474    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b43c84-f9bb6c4bc-c55jr"]
Oct 30 20:59:32.119350 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:32.119316    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa366927-7d3c-4595-82d5-0a75bec2f384" path="/var/lib/kubelet/pods/fa366927-7d3c-4595-82d5-0a75bec2f384/volumes"
Oct 30 20:59:35.116104 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:35.116075    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:59:35.116541 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:35.116253    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy" containerID="cri-o://9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3" gracePeriod=30
Oct 30 20:59:35.136256 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:35.136225    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:59:35.136415 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:35.136390    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy" containerID="cri-o://dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea" gracePeriod=30
Oct 30 20:59:40.403366 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.403336    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:59:40.419936 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.419901    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:59:40.518780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518757    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.518903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518835    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.518903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518858    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.518903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518885    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.518903 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518902    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518943    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.518977    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519021    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519076    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519105    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519107    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519145    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519165    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.519223 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519176    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519202    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519282    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519316    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519361    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\") pod \"29340b3a-b50c-4d12-b5df-39b1593f84a0\" (UID: \"29340b3a-b50c-4d12-b5df-39b1593f84a0\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519390    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519428    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519474    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.519671 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519517    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\") pod \"6aa0c662-83b8-4928-b47d-44da3cf6b608\" (UID: \"6aa0c662-83b8-4928-b47d-44da3cf6b608\") "
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.520037    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.520059    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519456    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.520073    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519611    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.520088    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519636    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519646    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.519959    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:40.520258 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.520193    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.521739 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.521697    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:40.521968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.521880    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "kube-api-access-jgpww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:40.521968 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.521950    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.522493 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.522465    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:40.522581 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.522510    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:40.522581 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.522514    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy" pod "29340b3a-b50c-4d12-b5df-39b1593f84a0" (UID: "29340b3a-b50c-4d12-b5df-39b1593f84a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:40.522731 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.522712    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "kube-api-access-gzpr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:40.523080 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.523059    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token" pod "6aa0c662-83b8-4928-b47d-44da3cf6b608" (UID: "6aa0c662-83b8-4928-b47d-44da3cf6b608"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:40.621346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621323    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621347    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29340b3a-b50c-4d12-b5df-39b1593f84a0-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621346 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621356    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgpww\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-kube-api-access-jgpww\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621366    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621375    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621383    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621392    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621400    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621408    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621415    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29340b3a-b50c-4d12-b5df-39b1593f84a0-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621423    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa0c662-83b8-4928-b47d-44da3cf6b608-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621432    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzpr5\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-kube-api-access-gzpr5\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621440    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa0c662-83b8-4928-b47d-44da3cf6b608-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.621535 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.621447    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa0c662-83b8-4928-b47d-44da3cf6b608-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:40.697180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.697071    5446 generic.go:356] "Generic (PLEG): container finished" podID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerID="dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea" exitCode=0
Oct 30 20:59:40.697180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.697132    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"
Oct 30 20:59:40.697437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.697219    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerDied","Data":"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"}
Oct 30 20:59:40.697437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.697272    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm" event={"ID":"29340b3a-b50c-4d12-b5df-39b1593f84a0","Type":"ContainerDied","Data":"c005f1607ad32969f8d2510af0dfeaecc1c1876a7c1f484f60e623758667e313"}
Oct 30 20:59:40.697437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.697302    5446 scope.go:122] "RemoveContainer" containerID="dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"
Oct 30 20:59:40.699956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.699719    5446 generic.go:356] "Generic (PLEG): container finished" podID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerID="9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3" exitCode=0
Oct 30 20:59:40.699956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.699781    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" event={"ID":"6aa0c662-83b8-4928-b47d-44da3cf6b608","Type":"ContainerDied","Data":"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"}
Oct 30 20:59:40.699956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.699857    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd" event={"ID":"6aa0c662-83b8-4928-b47d-44da3cf6b608","Type":"ContainerDied","Data":"9d33c9ba311afe974401e23e1b8c47e4a207cf428d22a4f107558273e4611e60"}
Oct 30 20:59:40.699956 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.699787    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"
Oct 30 20:59:40.709288 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.709266    5446 scope.go:122] "RemoveContainer" containerID="0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"
Oct 30 20:59:40.718574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.718558    5446 scope.go:122] "RemoveContainer" containerID="dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"
Oct 30 20:59:40.718850 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:40.718829    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea\": container with ID starting with dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea not found: ID does not exist" containerID="dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"
Oct 30 20:59:40.718900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.718860    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea"} err="failed to get container status \"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea\": rpc error: code = NotFound desc = could not find container \"dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea\": container with ID starting with dbacd61dde0ac232f5058cac536577350eaca85d39ce8c60679c9fc2b829adea not found: ID does not exist"
Oct 30 20:59:40.718900 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.718879    5446 scope.go:122] "RemoveContainer" containerID="0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"
Oct 30 20:59:40.719181 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:40.719163    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488\": container with ID starting with 0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488 not found: ID does not exist" containerID="0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"
Oct 30 20:59:40.719252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.719186    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488"} err="failed to get container status \"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488\": rpc error: code = NotFound desc = could not find container \"0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488\": container with ID starting with 0b1ab247852ddd66c92bd3dbe3ac94af0c913eba0052aaecbf3ebcc95ac39488 not found: ID does not exist"
Oct 30 20:59:40.719252 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.719201    5446 scope.go:122] "RemoveContainer" containerID="9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"
Oct 30 20:59:40.727792 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.727770    5446 scope.go:122] "RemoveContainer" containerID="9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"
Oct 30 20:59:40.728045 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:40.728027    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3\": container with ID starting with 9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3 not found: ID does not exist" containerID="9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"
Oct 30 20:59:40.728128 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.728053    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3"} err="failed to get container status \"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3\": rpc error: code = NotFound desc = could not find container \"9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3\": container with ID starting with 9316b4d60f15b42eb6896c240f2f7e6a6beb866dcdc518a3631843b26402b5f3 not found: ID does not exist"
Oct 30 20:59:40.871307 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.871267    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:59:40.876576 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.876548    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-7pkqm"]
Oct 30 20:59:40.986180 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.986114    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:59:40.991212 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:40.991190    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f6ebf5-openshift-default-79567845f5-qvxwd"]
Oct 30 20:59:41.059755 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:41.059728    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:59:41.060026 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:41.059996    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy" containerID="cri-o://420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b" gracePeriod=30
Oct 30 20:59:42.120369 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:42.120338    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" path="/var/lib/kubelet/pods/29340b3a-b50c-4d12-b5df-39b1593f84a0/volumes"
Oct 30 20:59:42.120984 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:42.120965    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" path="/var/lib/kubelet/pods/6aa0c662-83b8-4928-b47d-44da3cf6b608/volumes"
Oct 30 20:59:46.317370 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.317346    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:59:46.376644 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376621    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376755 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376702    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376799 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376768    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376837 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376795    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376835    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376853    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.376879 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376874    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.377050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376902    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.377050 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.376964    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\") pod \"f9ca5fe9-2837-4113-967f-bbdab03c259b\" (UID: \"f9ca5fe9-2837-4113-967f-bbdab03c259b\") "
Oct 30 20:59:46.377167 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377138    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:46.377230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377153    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:46.377230 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377216    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:46.377443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377408    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:46.377443 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377424    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:46.377574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377527    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.377574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377551    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.377574 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377567    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.377890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377580    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.377890 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.377593    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9ca5fe9-2837-4113-967f-bbdab03c259b-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.379273 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.379247    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "kube-api-access-j4x2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:46.379360 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.379313    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:46.379470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.379455    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:46.379470 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.379460    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token" pod "f9ca5fe9-2837-4113-967f-bbdab03c259b" (UID: "f9ca5fe9-2837-4113-967f-bbdab03c259b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:46.478701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.478676    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.478701 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.478697    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.478819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.478708    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4x2j\" (UniqueName: \"kubernetes.io/projected/f9ca5fe9-2837-4113-967f-bbdab03c259b-kube-api-access-j4x2j\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.478819 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.478717    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9ca5fe9-2837-4113-967f-bbdab03c259b-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:46.736957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.736869    5446 generic.go:356] "Generic (PLEG): container finished" podID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerID="420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b" exitCode=0
Oct 30 20:59:46.736957 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.736939    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"
Oct 30 20:59:46.737127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.736964    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" event={"ID":"f9ca5fe9-2837-4113-967f-bbdab03c259b","Type":"ContainerDied","Data":"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"}
Oct 30 20:59:46.737127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.737022    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn" event={"ID":"f9ca5fe9-2837-4113-967f-bbdab03c259b","Type":"ContainerDied","Data":"f4c04082874b4b80098601f12dfcd1ccbb7b720dd418922f067db24991de5317"}
Oct 30 20:59:46.737127 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.737054    5446 scope.go:122] "RemoveContainer" containerID="420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"
Oct 30 20:59:46.747156 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.747136    5446 scope.go:122] "RemoveContainer" containerID="420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"
Oct 30 20:59:46.747412 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:46.747395    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b\": container with ID starting with 420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b not found: ID does not exist" containerID="420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"
Oct 30 20:59:46.747461 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.747421    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b"} err="failed to get container status \"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b\": rpc error: code = NotFound desc = could not find container \"420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b\": container with ID starting with 420a7010fa9d8712380b8168e5c3c6c038e12c044cae9cb3364434958dc7932b not found: ID does not exist"
Oct 30 20:59:46.904661 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.904632    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:59:46.953487 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:46.953465    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b43c84-openshift-default-7b7d7b556f-pjwrn"]
Oct 30 20:59:48.119384 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:48.119350    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" path="/var/lib/kubelet/pods/f9ca5fe9-2837-4113-967f-bbdab03c259b/volumes"
Oct 30 20:59:49.516322 ip-10-0-135-188 kubenswrapper[5446]: E1030 20:59:49.516285    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 20:59:50.568169 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:50.568131    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:59:50.568593 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:50.568373    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" containerID="cri-o://a6151993a893ec476155ea0c04b4a8a52358a79aa29c7ee7c38291ede3e548e5" gracePeriod=30
Oct 30 20:59:54.303224 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:54.303183    5446 patch_prober.go:29] interesting pod/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:59:54.303624 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:54.303253    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:59:55.787673 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.787642    5446 generic.go:356] "Generic (PLEG): container finished" podID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerID="a6151993a893ec476155ea0c04b4a8a52358a79aa29c7ee7c38291ede3e548e5" exitCode=0
Oct 30 20:59:55.788056 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.787722    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" event={"ID":"74a29bb5-b348-40bc-ac04-8e69f48c640e","Type":"ContainerDied","Data":"a6151993a893ec476155ea0c04b4a8a52358a79aa29c7ee7c38291ede3e548e5"}
Oct 30 20:59:55.817506 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.817483    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:59:55.978923 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.978893    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.978985    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979015    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979107 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979049    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979176    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979210    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:55.979276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979247    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979276 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979253    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:55.979437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979305    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979353    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979437 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979388    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\") pod \"74a29bb5-b348-40bc-ac04-8e69f48c640e\" (UID: \"74a29bb5-b348-40bc-ac04-8e69f48c640e\") "
Oct 30 20:59:55.979591 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979568    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:55.979656 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979592    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:55.980017 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.979988    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:55.980150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.980089    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:55.980150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.980114    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:55.980150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.980130    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a29bb5-b348-40bc-ac04-8e69f48c640e-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:55.980150 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.980148    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:55.980373 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.980164    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:55.981480 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.981456    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:59:55.981480 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.981467    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "kube-api-access-hmjzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:55.981604 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.981484    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:55.981753 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:55.981738    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo" pod "74a29bb5-b348-40bc-ac04-8e69f48c640e" (UID: "74a29bb5-b348-40bc-ac04-8e69f48c640e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:59:56.081780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.081739    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmjzf\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-kube-api-access-hmjzf\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:56.081780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.081768    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:56.081780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.081778    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:56.081780 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.081787    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a29bb5-b348-40bc-ac04-8e69f48c640e-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:56.794287 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.794260    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"
Oct 30 20:59:56.794823 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.794264    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl" event={"ID":"74a29bb5-b348-40bc-ac04-8e69f48c640e","Type":"ContainerDied","Data":"d287f92678811a176f288061c2cfcf9bd4490969756c9eaea46c278f077e1942"}
Oct 30 20:59:56.794823 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:56.794387    5446 scope.go:122] "RemoveContainer" containerID="a6151993a893ec476155ea0c04b4a8a52358a79aa29c7ee7c38291ede3e548e5"
Oct 30 20:59:57.009716 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:57.009687    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:59:57.017133 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:57.017109    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-xrgsl"]
Oct 30 20:59:58.121440 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:58.121405    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" path="/var/lib/kubelet/pods/74a29bb5-b348-40bc-ac04-8e69f48c640e/volumes"
Oct 30 20:59:59.533543 ip-10-0-135-188 kubenswrapper[5446]: I1030 20:59:59.533506    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 21:00:00.171665 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.171625    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:00.172323 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172300    5446 cpu_manager.go:414] "containerMap: removing container" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172328    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172355    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172363    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172373    5446 cpu_manager.go:414] "containerMap: removing container" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172381    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172391    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main"
Oct 30 21:00:00.172396 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172398    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172407    5446 cpu_manager.go:414] "containerMap: removing container" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172414    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172430    5446 cpu_manager.go:414] "containerMap: removing container" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172436    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172447    5446 cpu_manager.go:414] "containerMap: removing container" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172454    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172467    5446 cpu_manager.go:414] "containerMap: removing container" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172477    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172491    5446 cpu_manager.go:414] "containerMap: removing container" podUID="fa366927-7d3c-4595-82d5-0a75bec2f384" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172498    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa366927-7d3c-4595-82d5-0a75bec2f384" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172507    5446 cpu_manager.go:414] "containerMap: removing container" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172514    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172522    5446 cpu_manager.go:414] "containerMap: removing container" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172528    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172536    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172542    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172550    5446 cpu_manager.go:414] "containerMap: removing container" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172556    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172568    5446 cpu_manager.go:414] "containerMap: removing container" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172573    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172579    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b1df9727-0c12-4c88-a238-ed274236a9ef" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172583    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1df9727-0c12-4c88-a238-ed274236a9ef" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172588    5446 cpu_manager.go:414] "containerMap: removing container" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172592    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172602    5446 cpu_manager.go:414] "containerMap: removing container" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172607    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172613    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172618    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172625    5446 cpu_manager.go:414] "containerMap: removing container" podUID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172629    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" containerName="maas-api"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172634    5446 cpu_manager.go:414] "containerMap: removing container" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172639    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172648    5446 cpu_manager.go:414] "containerMap: removing container" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172652    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172658    5446 cpu_manager.go:414] "containerMap: removing container" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172662    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172668    5446 cpu_manager.go:414] "containerMap: removing container" podUID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" containerName="payload-pre-processing"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172673    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" containerName="payload-pre-processing"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172679    5446 cpu_manager.go:414] "containerMap: removing container" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172683    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172694    5446 cpu_manager.go:414] "containerMap: removing container" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172698    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172704    5446 cpu_manager.go:414] "containerMap: removing container" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172708    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172714    5446 cpu_manager.go:414] "containerMap: removing container" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172719    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172728    5446 cpu_manager.go:414] "containerMap: removing container" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172732    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main"
Oct 30 21:00:00.172715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172738    5446 cpu_manager.go:414] "containerMap: removing container" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172743    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172751    5446 cpu_manager.go:414] "containerMap: removing container" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172755    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172761    5446 cpu_manager.go:414] "containerMap: removing container" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172765    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172770    5446 cpu_manager.go:414] "containerMap: removing container" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172774    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172782    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" containerName="payload-pre-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172786    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" containerName="payload-pre-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172794    5446 cpu_manager.go:414] "containerMap: removing container" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172798    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172806    5446 cpu_manager.go:414] "containerMap: removing container" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172811    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172819    5446 cpu_manager.go:414] "containerMap: removing container" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172824    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172831    5446 cpu_manager.go:414] "containerMap: removing container" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172835    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172841    5446 cpu_manager.go:414] "containerMap: removing container" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172846    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172853    5446 cpu_manager.go:414] "containerMap: removing container" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172856    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172863    5446 cpu_manager.go:414] "containerMap: removing container" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172867    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172873    5446 cpu_manager.go:414] "containerMap: removing container" podUID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172877    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172885    5446 cpu_manager.go:414] "containerMap: removing container" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172889    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172895    5446 cpu_manager.go:414] "containerMap: removing container" podUID="0122e012-b737-4de4-bc2d-5d788f033f8d" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.172899    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0122e012-b737-4de4-bc2d-5d788f033f8d" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173019    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a2af59a-80c9-42a9-a9af-d972710280d8" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173029    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="88f3ae25-a30c-4269-8ba3-a10640b99f49" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173038    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="b380dd1e-dd9d-4b76-b2e2-59f758f0cb5b" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173044    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f9f5b53-fd3f-4c48-a753-db6f3ef6e116" containerName="maas-api"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173050    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="29c46c14-c659-4868-93a7-8aedb25985ce" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173057    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="e24bfd77-163f-44ed-85bd-1183caf372fa" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173064    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173069    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2e98d9-d75c-4a93-ada5-d935c7e2274b" containerName="payload-pre-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173075    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3965dfb-d4a9-4fa9-ac03-576231952570" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173081    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="06558642-9198-456e-86cc-b4644dc8da26" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173085    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6d023d8-fc01-4c15-9e22-c39592c46938" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173091    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173096    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2ec952f-084e-4eb6-9a16-b00c4aef19d3" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173100    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="11971513-145a-4013-917d-e2addc37ffd1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173105    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="2cb944a1-df15-40cc-be03-d1dca27f799b" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173111    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="87c7712e-566e-4544-b28d-1d261560561a" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173116    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a8e0e11-4248-4879-b6d3-9ed77222ef84" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173121    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8c05be7-1cb3-4a93-8e1c-8ae67d049e1d" containerName="payload-pre-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173127    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="a79f53f9-11f1-46eb-8b6d-12df0337f833" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173134    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="0901e870-2a60-4ad1-b78a-21b1514022b1" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173140    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="74a29bb5-b348-40bc-ac04-8e69f48c640e" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173146    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="39f9832f-07dc-4ffd-af6c-937b169f2568" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173152    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173157    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="0858ca5e-a17c-4a04-890f-7f2b35dfe52e" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173161    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="6aa0c662-83b8-4928-b47d-44da3cf6b608" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173166    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a3ebc52-6f4e-4cfe-aa56-a36da956811c" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173170    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="67338f1c-e52a-40ed-a431-06614b480d8a" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173176    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="0122e012-b737-4de4-bc2d-5d788f033f8d" containerName="payload-processing"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173181    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ce32708-48b6-43f0-8ced-04043f96cbbf" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173186    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173192    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="539ff7e3-3945-4bad-a255-f8a287eb6e41" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173196    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="892fb78f-70d5-4b96-bb8e-101009d50b9b" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173201    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca50717d-68ff-4b38-8cc7-411c6ed4843f" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173206    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9b778a8-028f-4b00-aba1-50df14c8f738" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173212    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="98c6e90c-c3d8-4862-bbd9-84c4bf782946" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173218    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b97502a-e0a0-4316-8eb0-8a2e3d20c1a5" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173224    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa366927-7d3c-4595-82d5-0a75bec2f384" containerName="maas-api"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173230    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="576df3c2-c1cd-4e35-9dfd-4797092f2c29" containerName="main"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173235    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6eaa394-a7cc-47bb-9165-d1f695059dec" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173240    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9ca5fe9-2837-4113-967f-bbdab03c259b" containerName="istio-proxy"
Oct 30 21:00:00.174293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.173246    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1df9727-0c12-4c88-a238-ed274236a9ef" containerName="maas-api"
Oct 30 21:00:00.178018 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.178001    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.233856 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.233822    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:00.326003 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.325970    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.326003 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.326009    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbgwf\" (UniqueName: \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.329634 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.329604    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-78djw\""
Oct 30 21:00:00.427490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.427411    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.427490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.427450    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbgwf\" (UniqueName: \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.428128 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.428104    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.486237 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.486207    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbgwf\" (UniqueName: \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\") pod \"maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.491012 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.490988    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:00.868837 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.868813    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:00.872050 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:00:00.872021    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3736845a_865c_4ac9_af7d_74b9702057bd.slice/crio-1cb12208a86c0a6a606323a611b33513171dcaac6169a039459242dd8472a067 WatchSource:0}: Error finding container 1cb12208a86c0a6a606323a611b33513171dcaac6169a039459242dd8472a067: Status 404 returned error can't find the container with id 1cb12208a86c0a6a606323a611b33513171dcaac6169a039459242dd8472a067
Oct 30 21:00:00.874441 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:00.874424    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:00:01.822128 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:01.822090    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" event={"ID":"3736845a-865c-4ac9-af7d-74b9702057bd","Type":"ContainerStarted","Data":"1cb12208a86c0a6a606323a611b33513171dcaac6169a039459242dd8472a067"}
Oct 30 21:00:06.852710 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:06.852620    5446 generic.go:356] "Generic (PLEG): container finished" podID="3736845a-865c-4ac9-af7d-74b9702057bd" containerID="e2a3fa8fbab181d3b11c68b9b89c714876dea1c02c2ceccf4a3644ae76bf2413" exitCode=60
Oct 30 21:00:06.852710 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:06.852696    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" event={"ID":"3736845a-865c-4ac9-af7d-74b9702057bd","Type":"ContainerDied","Data":"e2a3fa8fbab181d3b11c68b9b89c714876dea1c02c2ceccf4a3644ae76bf2413"}
Oct 30 21:00:06.853251 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:06.853007    5446 scope.go:122] "RemoveContainer" containerID="e2a3fa8fbab181d3b11c68b9b89c714876dea1c02c2ceccf4a3644ae76bf2413"
Oct 30 21:00:07.868693 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:07.868657    5446 generic.go:356] "Generic (PLEG): container finished" podID="3736845a-865c-4ac9-af7d-74b9702057bd" containerID="fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea" exitCode=60
Oct 30 21:00:07.869178 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:07.868745    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" event={"ID":"3736845a-865c-4ac9-af7d-74b9702057bd","Type":"ContainerDied","Data":"fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea"}
Oct 30 21:00:07.869178 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:07.868831    5446 scope.go:122] "RemoveContainer" containerID="e2a3fa8fbab181d3b11c68b9b89c714876dea1c02c2ceccf4a3644ae76bf2413"
Oct 30 21:00:07.869178 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:07.868980    5446 scope.go:122] "RemoveContainer" containerID="fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea"
Oct 30 21:00:07.869343 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:07.869219    5446 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd_odh-ai-gateway-infra(3736845a-865c-4ac9-af7d-74b9702057bd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" podUID="3736845a-865c-4ac9-af7d-74b9702057bd"
Oct 30 21:00:08.877108 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:08.877078    5446 scope.go:122] "RemoveContainer" containerID="fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea"
Oct 30 21:00:08.877486 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:08.877321    5446 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd_odh-ai-gateway-infra(3736845a-865c-4ac9-af7d-74b9702057bd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" podUID="3736845a-865c-4ac9-af7d-74b9702057bd"
Oct 30 21:00:14.554353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.554288    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" containerID="cri-o://253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc" gracePeriod=45
Oct 30 21:00:14.567811 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.567771    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": dial tcp 10.133.0.59:8000: connect: connection refused"
Oct 30 21:00:14.849074 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.849047    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 21:00:14.873654 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.873628    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\" (UniqueName: \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.873774 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.873664    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.873893 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.873869    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.873955 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.873894    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:14.874019 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874004    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.874053 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874038    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.874098 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874067    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:14.874098 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874083    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\") pod \"ca38e01b-8054-465e-9074-70ed93f8dfc3\" (UID: \"ca38e01b-8054-465e-9074-70ed93f8dfc3\") "
Oct 30 21:00:14.874337 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874312    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:14.874504 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874489    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.874571 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874509    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.874571 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.874523    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.876170 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.876137    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:14.876264 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.876196    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "kube-api-access-b4twk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:14.876264 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.876209    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm" pod "ca38e01b-8054-465e-9074-70ed93f8dfc3" (UID: "ca38e01b-8054-465e-9074-70ed93f8dfc3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:14.910838 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.910809    5446 generic.go:356] "Generic (PLEG): container finished" podID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerID="253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc" exitCode=0
Oct 30 21:00:14.910992 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.910853    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"
Oct 30 21:00:14.910992 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.910905    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" event={"ID":"ca38e01b-8054-465e-9074-70ed93f8dfc3","Type":"ContainerDied","Data":"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"}
Oct 30 21:00:14.910992 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.910975    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr" event={"ID":"ca38e01b-8054-465e-9074-70ed93f8dfc3","Type":"ContainerDied","Data":"e3672ad16b3f2f6d5d01fa6afea1121c5639637a4d24fcee1731ea3fc2f24a77"}
Oct 30 21:00:14.911148 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.911000    5446 scope.go:122] "RemoveContainer" containerID="253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"
Oct 30 21:00:14.920818 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.920802    5446 scope.go:122] "RemoveContainer" containerID="253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"
Oct 30 21:00:14.921144 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:14.921123    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc\": container with ID starting with 253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc not found: ID does not exist" containerID="253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"
Oct 30 21:00:14.921195 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.921155    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc"} err="failed to get container status \"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc\": rpc error: code = NotFound desc = could not find container \"253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc\": container with ID starting with 253eed1113a6088958f9b8efa0fd9fcfa17d50e4e1010aef7583bc1f5dcfe8dc not found: ID does not exist"
Oct 30 21:00:14.976025 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.975997    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca38e01b-8054-465e-9074-70ed93f8dfc3-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.976025 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.976021    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca38e01b-8054-465e-9074-70ed93f8dfc3-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.976262 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:14.976032    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4twk\" (UniqueName: \"kubernetes.io/projected/ca38e01b-8054-465e-9074-70ed93f8dfc3-kube-api-access-b4twk\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:15.076950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:15.076853    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 21:00:15.081380 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:15.081355    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-ee3fad/distinct-w6-ee3fad-kserve-5644bbff5c-j4fmr"]
Oct 30 21:00:16.122564 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:16.122535    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" path="/var/lib/kubelet/pods/ca38e01b-8054-465e-9074-70ed93f8dfc3/volumes"
Oct 30 21:00:16.405950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:16.405843    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 21:00:16.406143 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:16.406112    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy" containerID="cri-o://12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc" gracePeriod=30
Oct 30 21:00:19.515665 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:19.515622    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:00:20.113804 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:20.113764    5446 scope.go:122] "RemoveContainer" containerID="fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea"
Oct 30 21:00:20.946591 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:20.946566    5446 generic.go:356] "Generic (PLEG): container finished" podID="3736845a-865c-4ac9-af7d-74b9702057bd" containerID="ea60bbb1455906e7726f682db735faa2ea262131e0c69b02f27d9e5cda79a6a1" exitCode=60
Oct 30 21:00:20.947017 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:20.946647    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" event={"ID":"3736845a-865c-4ac9-af7d-74b9702057bd","Type":"ContainerDied","Data":"ea60bbb1455906e7726f682db735faa2ea262131e0c69b02f27d9e5cda79a6a1"}
Oct 30 21:00:20.947017 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:20.946707    5446 scope.go:122] "RemoveContainer" containerID="fa27b57646ea117fc4f7089010961cc2c15f386392525178b0b82985d1f439ea"
Oct 30 21:00:20.947134 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:20.947097    5446 scope.go:122] "RemoveContainer" containerID="ea60bbb1455906e7726f682db735faa2ea262131e0c69b02f27d9e5cda79a6a1"
Oct 30 21:00:20.947355 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:20.947328    5446 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd_odh-ai-gateway-infra(3736845a-865c-4ac9-af7d-74b9702057bd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" podUID="3736845a-865c-4ac9-af7d-74b9702057bd"
Oct 30 21:00:21.648846 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.648824    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 21:00:21.742578 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742503    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742578 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742556    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742771 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742598    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742771 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742630    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742771 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742711    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742771    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742792    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742804    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742887    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742898    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.742986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.742971    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\") pod \"43b99149-6731-4c7f-9362-ec3d95f22c89\" (UID: \"43b99149-6731-4c7f-9362-ec3d95f22c89\") "
Oct 30 21:00:21.743310 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743144    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:21.743310 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743160    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:21.743310 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743224    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:21.743461 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743442    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.743510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743460    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.743510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743475    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43b99149-6731-4c7f-9362-ec3d95f22c89-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.743510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743487    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.743510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.743500    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.745283 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.745256    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:21.745372 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.745277    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "kube-api-access-cjw86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:21.745580 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.745562    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:21.745624 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.745563    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo" pod "43b99149-6731-4c7f-9362-ec3d95f22c89" (UID: "43b99149-6731-4c7f-9362-ec3d95f22c89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:00:21.844775 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.844732    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjw86\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-kube-api-access-cjw86\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.844775 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.844767    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.844983 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.844782    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.844983 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.844792    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43b99149-6731-4c7f-9362-ec3d95f22c89-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.953460 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.953428    5446 generic.go:356] "Generic (PLEG): container finished" podID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerID="12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc" exitCode=0
Oct 30 21:00:21.953863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.953477    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"
Oct 30 21:00:21.953863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.953514    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerDied","Data":"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"}
Oct 30 21:00:21.953863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.953562    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp" event={"ID":"43b99149-6731-4c7f-9362-ec3d95f22c89","Type":"ContainerDied","Data":"e87548da3407478af2f7d638bd3d4e608b993e0b59b6a80ebddb1e446eac01da"}
Oct 30 21:00:21.953863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.953583    5446 scope.go:122] "RemoveContainer" containerID="12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"
Oct 30 21:00:21.963486 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.963461    5446 scope.go:122] "RemoveContainer" containerID="c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"
Oct 30 21:00:21.971384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.971369    5446 scope.go:122] "RemoveContainer" containerID="12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"
Oct 30 21:00:21.971637 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:21.971617    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc\": container with ID starting with 12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc not found: ID does not exist" containerID="12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"
Oct 30 21:00:21.971679 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.971647    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc"} err="failed to get container status \"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc\": rpc error: code = NotFound desc = could not find container \"12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc\": container with ID starting with 12d864dd259949c679d9b2e96e6ec3c9ffa6d98308ae27dafc13c222dfad22bc not found: ID does not exist"
Oct 30 21:00:21.971679 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.971663    5446 scope.go:122] "RemoveContainer" containerID="c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"
Oct 30 21:00:21.971873 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:21.971857    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8\": container with ID starting with c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8 not found: ID does not exist" containerID="c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"
Oct 30 21:00:21.971927 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:21.971878    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8"} err="failed to get container status \"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8\": rpc error: code = NotFound desc = could not find container \"c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8\": container with ID starting with c8cac17a6c0f342a51c126f51e98488b22f5b46de303c7fb764847ddc31743f8 not found: ID does not exist"
Oct 30 21:00:22.072695 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.072635    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:22.123724 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.122523    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 21:00:22.131679 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.131646    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-386743-openshift-default-65c5f7bc77-qs8lp"]
Oct 30 21:00:22.194012 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.193988    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:22.249454 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.249428    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\" (UniqueName: \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\") pod \"3736845a-865c-4ac9-af7d-74b9702057bd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") "
Oct 30 21:00:22.249625 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.249549    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\") pod \"3736845a-865c-4ac9-af7d-74b9702057bd\" (UID: \"3736845a-865c-4ac9-af7d-74b9702057bd\") "
Oct 30 21:00:22.249903 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.249878    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca" pod "3736845a-865c-4ac9-af7d-74b9702057bd" (UID: "3736845a-865c-4ac9-af7d-74b9702057bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:22.250057 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.250020    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3736845a-865c-4ac9-af7d-74b9702057bd-maas-api-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:22.251698 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.251677    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf" pod "3736845a-865c-4ac9-af7d-74b9702057bd" (UID: "3736845a-865c-4ac9-af7d-74b9702057bd"). InnerVolumeSpecName "kube-api-access-xbgwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:22.351262 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.351198    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbgwf\" (UniqueName: \"kubernetes.io/projected/3736845a-865c-4ac9-af7d-74b9702057bd-kube-api-access-xbgwf\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:22.892630 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.892593    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 21:00:22.892824 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.892803    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" podUID="3c75fe46-a293-41ff-a641-19e62ad86202" containerName="maas-api" containerID="cri-o://19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004" gracePeriod=30
Oct 30 21:00:22.961960 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.961932    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"
Oct 30 21:00:22.961960 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.961952    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd" event={"ID":"3736845a-865c-4ac9-af7d-74b9702057bd","Type":"ContainerDied","Data":"1cb12208a86c0a6a606323a611b33513171dcaac6169a039459242dd8472a067"}
Oct 30 21:00:22.962445 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:22.962014    5446 scope.go:122] "RemoveContainer" containerID="ea60bbb1455906e7726f682db735faa2ea262131e0c69b02f27d9e5cda79a6a1"
Oct 30 21:00:23.124244 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.124209    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:23.130062 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.130033    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-395022-29889900-lcrqd"]
Oct 30 21:00:23.156828 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.156770    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 21:00:23.259371 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.259342    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\") pod \"3c75fe46-a293-41ff-a641-19e62ad86202\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") "
Oct 30 21:00:23.259546 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.259380    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") pod \"3c75fe46-a293-41ff-a641-19e62ad86202\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") "
Oct 30 21:00:23.259546 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.259470    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\") pod \"3c75fe46-a293-41ff-a641-19e62ad86202\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") "
Oct 30 21:00:23.259688 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.259610    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\" (UniqueName: \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\") pod \"3c75fe46-a293-41ff-a641-19e62ad86202\" (UID: \"3c75fe46-a293-41ff-a641-19e62ad86202\") "
Oct 30 21:00:23.259809 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.259787    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca" pod "3c75fe46-a293-41ff-a641-19e62ad86202" (UID: "3c75fe46-a293-41ff-a641-19e62ad86202"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:23.260064 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.260042    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c75fe46-a293-41ff-a641-19e62ad86202-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:23.261810 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.261784    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c" pod "3c75fe46-a293-41ff-a641-19e62ad86202" (UID: "3c75fe46-a293-41ff-a641-19e62ad86202"). InnerVolumeSpecName "kube-api-access-sqq2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:23.261892 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.261834    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs" pod "3c75fe46-a293-41ff-a641-19e62ad86202" (UID: "3c75fe46-a293-41ff-a641-19e62ad86202"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:23.261892 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.261850    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls" pod "3c75fe46-a293-41ff-a641-19e62ad86202" (UID: "3c75fe46-a293-41ff-a641-19e62ad86202"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:23.361267 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.361225    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqq2c\" (UniqueName: \"kubernetes.io/projected/3c75fe46-a293-41ff-a641-19e62ad86202-kube-api-access-sqq2c\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:23.361267 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.361259    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:23.361267 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.361270    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c75fe46-a293-41ff-a641-19e62ad86202-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:23.970308 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.970275    5446 generic.go:356] "Generic (PLEG): container finished" podID="3c75fe46-a293-41ff-a641-19e62ad86202" containerID="19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004" exitCode=0
Oct 30 21:00:23.970833 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.970326    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"
Oct 30 21:00:23.970833 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.970368    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" event={"ID":"3c75fe46-a293-41ff-a641-19e62ad86202","Type":"ContainerDied","Data":"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"}
Oct 30 21:00:23.970833 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.970417    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq" event={"ID":"3c75fe46-a293-41ff-a641-19e62ad86202","Type":"ContainerDied","Data":"fbc3a36dd9992855fa9fb187cbc17d43e3fd7bcedfc949d5562d9c0c6fc8fddb"}
Oct 30 21:00:23.970833 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.970446    5446 scope.go:122] "RemoveContainer" containerID="19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"
Oct 30 21:00:23.979967 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.979951    5446 scope.go:122] "RemoveContainer" containerID="19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"
Oct 30 21:00:23.980249 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:23.980231    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004\": container with ID starting with 19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004 not found: ID does not exist" containerID="19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"
Oct 30 21:00:23.980310 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:23.980257    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004"} err="failed to get container status \"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004\": rpc error: code = NotFound desc = could not find container \"19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004\": container with ID starting with 19f91037a511f13c2d184dc4b5fab08ec0cfc3cdd4e3e2f0ed01f1992fffd004 not found: ID does not exist"
Oct 30 21:00:24.120641 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:24.120605    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" path="/var/lib/kubelet/pods/3736845a-865c-4ac9-af7d-74b9702057bd/volumes"
Oct 30 21:00:24.121163 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:24.121142    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" path="/var/lib/kubelet/pods/43b99149-6731-4c7f-9362-ec3d95f22c89/volumes"
Oct 30 21:00:24.135738 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:24.135711    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 21:00:24.142671 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:24.142647    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee3fad-878ccd6cc-lm7kq"]
Oct 30 21:00:26.119183 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:26.119151    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c75fe46-a293-41ff-a641-19e62ad86202" path="/var/lib/kubelet/pods/3c75fe46-a293-41ff-a641-19e62ad86202/volumes"
Oct 30 21:00:32.366828 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:32.366491    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 21:00:32.366828 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:32.366755    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy" containerID="cri-o://1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11" gracePeriod=30
Oct 30 21:00:37.644980 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.644908    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 21:00:37.719351 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719322    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719501 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719357    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719501 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719387    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719501 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719410    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719501 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719467    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719515    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719559    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719594    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:37.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719647    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719698    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\") pod \"ef46e2a7-c916-4e37-9879-890f49b172b6\" (UID: \"ef46e2a7-c916-4e37-9879-890f49b172b6\") "
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719772    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719797    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719895    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.719944    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.720093    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef46e2a7-c916-4e37-9879-890f49b172b6-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.720108    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.720117    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.720126    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.720079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.720135    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.721734 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.721704    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:37.721840 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.721775    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:37.721886 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.721871    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "kube-api-access-4pfqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:37.722005 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.721989    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo" pod "ef46e2a7-c916-4e37-9879-890f49b172b6" (UID: "ef46e2a7-c916-4e37-9879-890f49b172b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:00:37.821064 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.821037    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.821064 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.821065    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pfqh\" (UniqueName: \"kubernetes.io/projected/ef46e2a7-c916-4e37-9879-890f49b172b6-kube-api-access-4pfqh\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.821227 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.821079    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:37.821227 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:37.821093    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef46e2a7-c916-4e37-9879-890f49b172b6-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:38.047859 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.047774    5446 generic.go:356] "Generic (PLEG): container finished" podID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerID="1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11" exitCode=0
Oct 30 21:00:38.047859 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.047846    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"
Oct 30 21:00:38.048058 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.047858    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerDied","Data":"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"}
Oct 30 21:00:38.048058 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.047962    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5" event={"ID":"ef46e2a7-c916-4e37-9879-890f49b172b6","Type":"ContainerDied","Data":"5b5eb4b9b15b096fe7c2ba97110be29714869683478523903ef47d69ae189b4e"}
Oct 30 21:00:38.048058 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.047989    5446 scope.go:122] "RemoveContainer" containerID="1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"
Oct 30 21:00:38.059049 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.059030    5446 scope.go:122] "RemoveContainer" containerID="d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"
Oct 30 21:00:38.069777 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.069761    5446 scope.go:122] "RemoveContainer" containerID="1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"
Oct 30 21:00:38.070060 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:38.070037    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11\": container with ID starting with 1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11 not found: ID does not exist" containerID="1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"
Oct 30 21:00:38.070122 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.070070    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11"} err="failed to get container status \"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11\": rpc error: code = NotFound desc = could not find container \"1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11\": container with ID starting with 1ffaaa3bea31f09d6140d93d59055442df3071fb44c182cae330784630d16b11 not found: ID does not exist"
Oct 30 21:00:38.070122 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.070088    5446 scope.go:122] "RemoveContainer" containerID="d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"
Oct 30 21:00:38.070357 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:38.070338    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038\": container with ID starting with d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038 not found: ID does not exist" containerID="d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"
Oct 30 21:00:38.070407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.070363    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038"} err="failed to get container status \"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038\": rpc error: code = NotFound desc = could not find container \"d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038\": container with ID starting with d5311e435acdfb09a93557473a5dc2e904822f98c9bee2fa42f622ca4887b038 not found: ID does not exist"
Oct 30 21:00:38.216989 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.216960    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 21:00:38.266877 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:38.266844    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-ee3fad-openshift-default-85fc9d9645-pk5d5"]
Oct 30 21:00:40.119623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:40.119593    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" path="/var/lib/kubelet/pods/ef46e2a7-c916-4e37-9879-890f49b172b6/volumes"
Oct 30 21:00:40.209805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:40.209774    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 21:00:47.386664 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:47.386629    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 21:00:49.515676 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:49.515638    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:00:52.387242 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:52.387177    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing" containerID="cri-o://1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1" gracePeriod=25
Oct 30 21:00:53.834405 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:53.834371    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:00:55.229848 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.229792    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main" containerID="cri-o://13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7" gracePeriod=45
Oct 30 21:00:55.482207 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.482146    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 21:00:55.579683 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579654    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.579842 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579706    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.579842 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579738    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.580009 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579846    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\" (UniqueName: \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.580009 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579875    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\" (UniqueName: \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.580009 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579967    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:55.580009 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579990    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:55.580009 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.579994    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\") pod \"cbee0c56-d08a-4a39-bc66-d145e59126cf\" (UID: \"cbee0c56-d08a-4a39-bc66-d145e59126cf\") "
Oct 30 21:00:55.580280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.580107    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:55.580442 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.580420    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.580525 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.580446    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.580525 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.580462    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.582945 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.582888    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:55.584046 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.584019    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:00:55.584228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.584209    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr" pod "cbee0c56-d08a-4a39-bc66-d145e59126cf" (UID: "cbee0c56-d08a-4a39-bc66-d145e59126cf"). InnerVolumeSpecName "kube-api-access-2wssr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:55.681272 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.681238    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbee0c56-d08a-4a39-bc66-d145e59126cf-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.681272 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.681271    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbee0c56-d08a-4a39-bc66-d145e59126cf-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.681482 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:55.681284    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wssr\" (UniqueName: \"kubernetes.io/projected/cbee0c56-d08a-4a39-bc66-d145e59126cf-kube-api-access-2wssr\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:56.137794 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.137764    5446 generic.go:356] "Generic (PLEG): container finished" podID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerID="13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7" exitCode=0
Oct 30 21:00:56.137950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.137809    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"
Oct 30 21:00:56.137950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.137852    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" event={"ID":"cbee0c56-d08a-4a39-bc66-d145e59126cf","Type":"ContainerDied","Data":"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"}
Oct 30 21:00:56.137950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.137901    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2" event={"ID":"cbee0c56-d08a-4a39-bc66-d145e59126cf","Type":"ContainerDied","Data":"94c6167938717f17f6f563478f087ce74e6c3d1671d7919e36d1dad37423725e"}
Oct 30 21:00:56.137950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.137939    5446 scope.go:122] "RemoveContainer" containerID="13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"
Oct 30 21:00:56.146832 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.146807    5446 scope.go:122] "RemoveContainer" containerID="13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"
Oct 30 21:00:56.147195 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:00:56.147177    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7\": container with ID starting with 13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7 not found: ID does not exist" containerID="13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"
Oct 30 21:00:56.147269 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.147206    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7"} err="failed to get container status \"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7\": rpc error: code = NotFound desc = could not find container \"13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7\": container with ID starting with 13e0419eb733a274b527196bf3b4d6f647131d702e80638c025b21677d61afa7 not found: ID does not exist"
Oct 30 21:00:56.301399 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.301365    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 21:00:56.350061 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:56.350033    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-395022/simulator-w4-395022-kserve-b6469f6c6-wlgx2"]
Oct 30 21:00:58.119558 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:00:58.119524    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" path="/var/lib/kubelet/pods/cbee0c56-d08a-4a39-bc66-d145e59126cf/volumes"
Oct 30 21:01:03.834224 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:03.834183    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:01:11.020267 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.020223    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 21:01:11.020758 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.020506    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" podUID="4d4a354f-8717-4fd0-816b-f26707460cce" containerName="maas-api" containerID="cri-o://44580afbbde07075dffca5847c18334da09bb2bb1974b9da193cf678d4deb2d6" gracePeriod=30
Oct 30 21:01:11.215518 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.215489    5446 generic.go:356] "Generic (PLEG): container finished" podID="4d4a354f-8717-4fd0-816b-f26707460cce" containerID="44580afbbde07075dffca5847c18334da09bb2bb1974b9da193cf678d4deb2d6" exitCode=0
Oct 30 21:01:11.215695 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.215563    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" event={"ID":"4d4a354f-8717-4fd0-816b-f26707460cce","Type":"ContainerDied","Data":"44580afbbde07075dffca5847c18334da09bb2bb1974b9da193cf678d4deb2d6"}
Oct 30 21:01:11.288516 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.288490    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 21:01:11.443855 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.443817    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\" (UniqueName: \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\") pod \"4d4a354f-8717-4fd0-816b-f26707460cce\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") "
Oct 30 21:01:11.444088 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.443869    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\") pod \"4d4a354f-8717-4fd0-816b-f26707460cce\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") "
Oct 30 21:01:11.444088 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.443986    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") pod \"4d4a354f-8717-4fd0-816b-f26707460cce\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") "
Oct 30 21:01:11.444088 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.444065    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\") pod \"4d4a354f-8717-4fd0-816b-f26707460cce\" (UID: \"4d4a354f-8717-4fd0-816b-f26707460cce\") "
Oct 30 21:01:11.444383 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.444354    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca" pod "4d4a354f-8717-4fd0-816b-f26707460cce" (UID: "4d4a354f-8717-4fd0-816b-f26707460cce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:11.446954 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.446885    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw" pod "4d4a354f-8717-4fd0-816b-f26707460cce" (UID: "4d4a354f-8717-4fd0-816b-f26707460cce"). InnerVolumeSpecName "kube-api-access-klsxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:11.447228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.447202    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls" pod "4d4a354f-8717-4fd0-816b-f26707460cce" (UID: "4d4a354f-8717-4fd0-816b-f26707460cce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:11.449063 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.449036    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs" pod "4d4a354f-8717-4fd0-816b-f26707460cce" (UID: "4d4a354f-8717-4fd0-816b-f26707460cce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:11.546466 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.546288    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klsxw\" (UniqueName: \"kubernetes.io/projected/4d4a354f-8717-4fd0-816b-f26707460cce-kube-api-access-klsxw\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:11.546466 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.546328    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4a354f-8717-4fd0-816b-f26707460cce-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:11.546466 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.546343    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:11.546466 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:11.546361    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d4a354f-8717-4fd0-816b-f26707460cce-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:12.222479 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.222444    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"
Oct 30 21:01:12.222934 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.222481    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf" event={"ID":"4d4a354f-8717-4fd0-816b-f26707460cce","Type":"ContainerDied","Data":"f639059bd375ac138555039dafd22afcd34f34ab62124165fc7e709ad2a3eb63"}
Oct 30 21:01:12.222934 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.222556    5446 scope.go:122] "RemoveContainer" containerID="44580afbbde07075dffca5847c18334da09bb2bb1974b9da193cf678d4deb2d6"
Oct 30 21:01:12.388695 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.388632    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 21:01:12.437995 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.437965    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-395022-67f5747c5b-lt2kf"]
Oct 30 21:01:12.633642 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.633610    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 21:01:12.759910 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.758836    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\") pod \"a757e49a-f64c-4667-beba-9765dbd2669a\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") "
Oct 30 21:01:12.759910 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.759025    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\" (UniqueName: \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\") pod \"a757e49a-f64c-4667-beba-9765dbd2669a\" (UID: \"a757e49a-f64c-4667-beba-9765dbd2669a\") "
Oct 30 21:01:12.760716 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.760686    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume" pod "a757e49a-f64c-4667-beba-9765dbd2669a" (UID: "a757e49a-f64c-4667-beba-9765dbd2669a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:12.768159 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.768134    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5" pod "a757e49a-f64c-4667-beba-9765dbd2669a" (UID: "a757e49a-f64c-4667-beba-9765dbd2669a"). InnerVolumeSpecName "kube-api-access-58kb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:12.860097 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.860071    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a757e49a-f64c-4667-beba-9765dbd2669a-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:12.860097 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:12.860094    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58kb5\" (UniqueName: \"kubernetes.io/projected/a757e49a-f64c-4667-beba-9765dbd2669a-kube-api-access-58kb5\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:13.229560 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.229524    5446 generic.go:356] "Generic (PLEG): container finished" podID="a757e49a-f64c-4667-beba-9765dbd2669a" containerID="1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1" exitCode=0
Oct 30 21:01:13.230069 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.229573    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" event={"ID":"a757e49a-f64c-4667-beba-9765dbd2669a","Type":"ContainerDied","Data":"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"}
Oct 30 21:01:13.230069 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.229578    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"
Oct 30 21:01:13.230069 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.229619    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf" event={"ID":"a757e49a-f64c-4667-beba-9765dbd2669a","Type":"ContainerDied","Data":"10969a61ba950e07eff8a6cbcb2ebad446c71ca767384f15ebd5114b900e48e0"}
Oct 30 21:01:13.230069 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.229640    5446 scope.go:122] "RemoveContainer" containerID="1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"
Oct 30 21:01:13.239076 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.239033    5446 scope.go:122] "RemoveContainer" containerID="1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"
Oct 30 21:01:13.239289 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:01:13.239270    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1\": container with ID starting with 1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1 not found: ID does not exist" containerID="1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"
Oct 30 21:01:13.239339 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.239299    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1"} err="failed to get container status \"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1\": rpc error: code = NotFound desc = could not find container \"1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1\": container with ID starting with 1e60c1329ec6b17da2cbe446ec99f1ddb32362ae57f9b90df794c337ea5619c1 not found: ID does not exist"
Oct 30 21:01:13.393699 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.393678    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 21:01:13.442625 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:13.442608    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-395022-6644d6b65b-hq7bf"]
Oct 30 21:01:14.119622 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:14.119588    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d4a354f-8717-4fd0-816b-f26707460cce" path="/var/lib/kubelet/pods/4d4a354f-8717-4fd0-816b-f26707460cce/volumes"
Oct 30 21:01:14.119989 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:14.119974    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" path="/var/lib/kubelet/pods/a757e49a-f64c-4667-beba-9765dbd2669a/volumes"
Oct 30 21:01:19.514536 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:01:19.514503    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:01:21.826537 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:21.826503    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 21:01:21.827007 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:21.826703    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" containerID="cri-o://d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45" gracePeriod=30
Oct 30 21:01:23.316724 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:23.316683    5446 patch_prober.go:29] interesting pod/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:01:23.317103 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:23.316747    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:01:27.073849 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.073826    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 21:01:27.189223 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189199    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189231    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189261    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189288    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189321    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189359    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189384 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189378    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189408    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189455    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\") pod \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\" (UID: \"c1f20541-9b06-4fcd-bf7d-24b0891a353b\") "
Oct 30 21:01:27.189715 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189663    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:27.189877 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189743    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:27.189877 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189759    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:27.189877 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189870    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.190077 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189888    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.190077 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189903    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.190077 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.189976    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:27.190223 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.190134    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:27.192253 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.192232    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:01:27.192353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.192247    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:27.192353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.192309    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:01:27.192487 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.192467    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn" pod "c1f20541-9b06-4fcd-bf7d-24b0891a353b" (UID: "c1f20541-9b06-4fcd-bf7d-24b0891a353b"). InnerVolumeSpecName "kube-api-access-9znzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:27.291103 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291076    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.291103 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291101    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.291103 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291110    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.291387 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291120    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9znzn\" (UniqueName: \"kubernetes.io/projected/c1f20541-9b06-4fcd-bf7d-24b0891a353b-kube-api-access-9znzn\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.291387 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291129    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.291387 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.291137    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f20541-9b06-4fcd-bf7d-24b0891a353b-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:27.300144 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.300112    5446 generic.go:356] "Generic (PLEG): container finished" podID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerID="d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45" exitCode=0
Oct 30 21:01:27.300307 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.300216    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"
Oct 30 21:01:27.300307 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.300216    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerDied","Data":"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"}
Oct 30 21:01:27.300307 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.300292    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2" event={"ID":"c1f20541-9b06-4fcd-bf7d-24b0891a353b","Type":"ContainerDied","Data":"a04001eba4518424e9a1a3f98feaab2d2d15539f78c7a5a71a95745bb57746a5"}
Oct 30 21:01:27.300490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.300322    5446 scope.go:122] "RemoveContainer" containerID="d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"
Oct 30 21:01:27.312121 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.312095    5446 scope.go:122] "RemoveContainer" containerID="a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"
Oct 30 21:01:27.320653 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.320635    5446 scope.go:122] "RemoveContainer" containerID="d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"
Oct 30 21:01:27.320976 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:01:27.320960    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45\": container with ID starting with d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45 not found: ID does not exist" containerID="d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"
Oct 30 21:01:27.321043 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.320985    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45"} err="failed to get container status \"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45\": rpc error: code = NotFound desc = could not find container \"d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45\": container with ID starting with d4ea80bd8b6df701c5bb7201b641a0bfab23a22e53ab050b064f5dd13b5cce45 not found: ID does not exist"
Oct 30 21:01:27.321043 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.321002    5446 scope.go:122] "RemoveContainer" containerID="a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"
Oct 30 21:01:27.321253 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:01:27.321237    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f\": container with ID starting with a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f not found: ID does not exist" containerID="a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"
Oct 30 21:01:27.321301 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.321258    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f"} err="failed to get container status \"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f\": rpc error: code = NotFound desc = could not find container \"a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f\": container with ID starting with a53e2022822d4d2ee7a1ce76a38b941c0ac4b71355d6f3172c907667cb68ee3f not found: ID does not exist"
Oct 30 21:01:27.466743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.466660    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 21:01:27.473552 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:27.473518    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-395022-openshift-default-559878f94c-qlth2"]
Oct 30 21:01:28.118389 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:28.118347    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" path="/var/lib/kubelet/pods/c1f20541-9b06-4fcd-bf7d-24b0891a353b/volumes"
Oct 30 21:01:41.177839 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.177810    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"]
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178194    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178205    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178215    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178220    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178231    5446 cpu_manager.go:414] "containerMap: removing container" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178237    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178247    5446 cpu_manager.go:414] "containerMap: removing container" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178251    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178265    5446 cpu_manager.go:414] "containerMap: removing container" podUID="4d4a354f-8717-4fd0-816b-f26707460cce" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178269    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d4a354f-8717-4fd0-816b-f26707460cce" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178277    5446 cpu_manager.go:414] "containerMap: removing container" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178281    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178289    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178293    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178301    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178305    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178312    5446 cpu_manager.go:414] "containerMap: removing container" podUID="3c75fe46-a293-41ff-a641-19e62ad86202" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178316    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c75fe46-a293-41ff-a641-19e62ad86202" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178323    5446 cpu_manager.go:414] "containerMap: removing container" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178327    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178336    5446 cpu_manager.go:414] "containerMap: removing container" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178340    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178349    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178353    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178411    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178419    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178426    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c75fe46-a293-41ff-a641-19e62ad86202" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178431    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="29340b3a-b50c-4d12-b5df-39b1593f84a0" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178435    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178441    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178453    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178458    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178464    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0ce08fb-ea2f-4937-b9a6-d187bdb08647" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178469    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178475    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef46e2a7-c916-4e37-9879-890f49b172b6" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178480    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca38e01b-8054-465e-9074-70ed93f8dfc3" containerName="main"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178485    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="a757e49a-f64c-4667-beba-9765dbd2669a" containerName="payload-processing"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178491    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178495    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ce1bb6-df76-4453-951d-daa3b4d07ce9" containerName="istio-proxy"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178501    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d4a354f-8717-4fd0-816b-f26707460cce" containerName="maas-api"
Oct 30 21:01:41.178589 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.178507    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbee0c56-d08a-4a39-bc66-d145e59126cf" containerName="main"
Oct 30 21:01:41.181419 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.181401    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.227195 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227171    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"]
Oct 30 21:01:41.227542 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227529    5446 cpu_manager.go:414] "containerMap: removing container" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.227593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227543    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43b99149-6731-4c7f-9362-ec3d95f22c89" containerName="istio-proxy"
Oct 30 21:01:41.227593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227564    5446 cpu_manager.go:414] "containerMap: removing container" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.227593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227570    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1f20541-9b06-4fcd-bf7d-24b0891a353b" containerName="istio-proxy"
Oct 30 21:01:41.227593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227583    5446 cpu_manager.go:414] "containerMap: removing container" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.227593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.227588    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3736845a-865c-4ac9-af7d-74b9702057bd" containerName="cleanup"
Oct 30 21:01:41.230553 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.230536    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.282875 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.282852    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"]
Oct 30 21:01:41.326791 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.326766    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f1acdf-95cd-41f7-9924-d96419b99562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.326904 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.326848    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxrv\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-kube-api-access-9hxrv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.326904 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.326886    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327013 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.326974    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327013 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327000    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327102 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327070    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327156 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327105    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327208 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327182    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931ffb02-16c9-49ca-8aad-55a682e64209-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327261 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327217    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bktlt\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-kube-api-access-bktlt\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327317 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327279    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327377 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327356    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931ffb02-16c9-49ca-8aad-55a682e64209-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327430 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327414    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327486 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327442    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327486 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327469    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327558 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327516    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327558 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327544    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.327641 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327582    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.327641 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.327613    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.333165 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.333143    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"]
Oct 30 21:01:41.428509 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428444    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.428509 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428498    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.428703 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428522    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.428703 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428552    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f1acdf-95cd-41f7-9924-d96419b99562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.428703 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428579    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxrv\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-kube-api-access-9hxrv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.428934 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428885    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429073 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428607    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429148 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429071    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429148 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.428952    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429148 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429100    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429159    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429193    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429221    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429261    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931ffb02-16c9-49ca-8aad-55a682e64209-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429292    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlt\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-kube-api-access-bktlt\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429331    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429376    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931ffb02-16c9-49ca-8aad-55a682e64209-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429391    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429392    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f1acdf-95cd-41f7-9924-d96419b99562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429456    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429485    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429514    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.429565 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429538    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.430181 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429733    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-certs\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.430181 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429948    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-workload-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.430181 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429956    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-data\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.430181 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.429989    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-credential-socket\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.430181 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.430068    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931ffb02-16c9-49ca-8aad-55a682e64209-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.432017 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.431992    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.432364 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.432340    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931ffb02-16c9-49ca-8aad-55a682e64209-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.432724 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.432706    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-envoy\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.433087 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.433067    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931ffb02-16c9-49ca-8aad-55a682e64209-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.486266 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.486239    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.486374 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.486251    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxrv\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-kube-api-access-9hxrv\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.486758 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.486735    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931ffb02-16c9-49ca-8aad-55a682e64209-istio-token\") pod \"maas-default-gateway-openshift-default-58847f9fc5-wlz59\" (UID: \"931ffb02-16c9-49ca-8aad-55a682e64209\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.486863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.486850    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bktlt\" (UniqueName: \"kubernetes.io/projected/c8f1acdf-95cd-41f7-9924-d96419b99562-kube-api-access-bktlt\") pod \"maas-default-gateway-openshift-default-58847f9fc5-4pc86\" (UID: \"c8f1acdf-95cd-41f7-9924-d96419b99562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.493564 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.493540    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:41.544004 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.543970    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:41.922092 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.922060    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"]
Oct 30 21:01:41.924425 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:01:41.924394    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931ffb02_16c9_49ca_8aad_55a682e64209.slice/crio-a1e520d7baae4d6c701c02b9df38bdefecd7615fc3abf5421fae38ad0420a60f WatchSource:0}: Error finding container a1e520d7baae4d6c701c02b9df38bdefecd7615fc3abf5421fae38ad0420a60f: Status 404 returned error can't find the container with id a1e520d7baae4d6c701c02b9df38bdefecd7615fc3abf5421fae38ad0420a60f
Oct 30 21:01:41.926594 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.926564    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:41.926684 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.926625    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:41.926684 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.926671    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:41.975600 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.975575    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"]
Oct 30 21:01:41.978557 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:01:41.978530    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f1acdf_95cd_41f7_9924_d96419b99562.slice/crio-c695392289900e2151f6e52cd3ff5c828b3cca946f62e1045f925ac63030a7d2 WatchSource:0}: Error finding container c695392289900e2151f6e52cd3ff5c828b3cca946f62e1045f925ac63030a7d2: Status 404 returned error can't find the container with id c695392289900e2151f6e52cd3ff5c828b3cca946f62e1045f925ac63030a7d2
Oct 30 21:01:41.980930 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.980886    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:41.981034 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.980989    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:41.981099 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:41.981035    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:42.384006 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.383959    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" event={"ID":"c8f1acdf-95cd-41f7-9924-d96419b99562","Type":"ContainerStarted","Data":"b1d85a7bbf70997319abe6c55080afae5b9d12c49d761168ef4a2545737c6742"}
Oct 30 21:01:42.384606 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.384571    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" event={"ID":"c8f1acdf-95cd-41f7-9924-d96419b99562","Type":"ContainerStarted","Data":"c695392289900e2151f6e52cd3ff5c828b3cca946f62e1045f925ac63030a7d2"}
Oct 30 21:01:42.388296 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.388261    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" event={"ID":"931ffb02-16c9-49ca-8aad-55a682e64209","Type":"ContainerStarted","Data":"8c504edba904140385c716f8566c99f3c5c3bf67b10e1e05f01e6565932dbd77"}
Oct 30 21:01:42.388434 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.388311    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" event={"ID":"931ffb02-16c9-49ca-8aad-55a682e64209","Type":"ContainerStarted","Data":"a1e520d7baae4d6c701c02b9df38bdefecd7615fc3abf5421fae38ad0420a60f"}
Oct 30 21:01:42.504330 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.504299    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:42.508939 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.505712    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podStartSLOduration=1.505696014 podStartE2EDuration="1.505696014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:42.505126252 +0000 UTC m=+2068.497129381" watchObservedRunningTime="2026-10-30 21:01:42.505696014 +0000 UTC m=+2068.497699142"
Oct 30 21:01:42.523052 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.523013    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:42.523333 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.523303    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:42.544564 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:42.544537    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:43.494472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:43.494427    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:43.495136 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:43.495086    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:43.546512 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:43.546478    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:43.546670 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:43.546529    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:44.504943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:44.496641    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:44.504943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:44.496716    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:44.545137 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:44.545104    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:44.545305 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:44.545165    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:45.506943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:45.505245    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:45.506943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:45.505316    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:45.545187 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:45.545149    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:45.545369 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:45.545216    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:46.498948 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:46.498247    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:46.498948 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:46.498305    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:46.544517 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:46.544427    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:46.544517 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:46.544474    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:47.497336 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:47.497297    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:47.497708 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:47.497677    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:47.544510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:47.544481    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:47.544732 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:47.544711    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:48.494210 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:48.494179    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:48.494361 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:48.494243    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:48.544579 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:48.544547    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:48.544694 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:48.544602    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:49.494291 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:49.494254    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:01:49.494677 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:49.494319    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Oct 30 21:01:49.515947 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:01:49.515877    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:01:49.545074 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:49.545041    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:01:49.545193 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:49.545113    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Oct 30 21:01:50.497697 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.497668    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:50.498162 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.497950    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:50.498731 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.498713    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59"
Oct 30 21:01:50.548376 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.548349    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:50.548604 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.548586    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:50.549327 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.549309    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86"
Oct 30 21:01:50.714781 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:01:50.714719    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podStartSLOduration=9.714705615 podStartE2EDuration="9.714705615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:42.627394804 +0000 UTC m=+2068.619397932" watchObservedRunningTime="2026-10-30 21:01:50.714705615 +0000 UTC m=+2076.706708798"
Oct 30 21:02:19.515887 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:02:19.515847    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:02:49.515833 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:02:49.515798    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:03:19.515554 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:03:19.515517    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:03:49.516151 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:03:49.516055    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:04:06.554944 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:06.554014    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:04:06.554944 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:06.554080    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:04:06.609939 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:06.604004    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:04:06.609939 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:06.604079    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:04:19.516380 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:04:19.516341    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:04:48.524870 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.524837    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 21:04:48.525382 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.525041    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery" containerID="cri-o://8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a" gracePeriod=30
Oct 30 21:04:48.775407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.775349    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 21:04:48.874535 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874497    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.874728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874579    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.874728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874681    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.874863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874757    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.874863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874792    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.874863 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874822    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.875052 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.874878    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\") pod \"7e6415dd-c90a-4c98-b68d-d6959d925a04\" (UID: \"7e6415dd-c90a-4c98-b68d-d6959d925a04\") "
Oct 30 21:04:48.875318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.875193    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:48.875318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.875276    5446 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-ca-configmap\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.877236 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877210    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:48.877504 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877481    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:48.877612 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877528    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:48.877675 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877641    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "kube-api-access-5vdt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:48.877738 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877681    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:48.877738 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.877698    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig" pod "7e6415dd-c90a-4c98-b68d-d6959d925a04" (UID: "7e6415dd-c90a-4c98-b68d-d6959d925a04"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:48.976328 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976299    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.976328 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976323    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vdt6\" (UniqueName: \"kubernetes.io/projected/7e6415dd-c90a-4c98-b68d-d6959d925a04-kube-api-access-5vdt6\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.976328 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976334    5446 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6415dd-c90a-4c98-b68d-d6959d925a04-local-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.976560 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976344    5446 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-csr-dns-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.976560 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976352    5446 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-istio-kubeconfig\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:48.976560 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:48.976361    5446 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7e6415dd-c90a-4c98-b68d-d6959d925a04-cacerts\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:49.423404 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.423368    5446 generic.go:356] "Generic (PLEG): container finished" podID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerID="8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a" exitCode=0
Oct 30 21:04:49.423556 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.423416    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"
Oct 30 21:04:49.423556 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.423461    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" event={"ID":"7e6415dd-c90a-4c98-b68d-d6959d925a04","Type":"ContainerDied","Data":"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"}
Oct 30 21:04:49.423556 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.423515    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" event={"ID":"7e6415dd-c90a-4c98-b68d-d6959d925a04","Type":"ContainerDied","Data":"63ff3dc653de54ca9b504b1d4fdae36176a6457e3a01d0b9b8703b6d57e54b6d"}
Oct 30 21:04:49.423556 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.423537    5446 scope.go:122] "RemoveContainer" containerID="8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"
Oct 30 21:04:49.438477 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.438458    5446 scope.go:122] "RemoveContainer" containerID="8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"
Oct 30 21:04:49.438767 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:04:49.438741    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a\": container with ID starting with 8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a not found: ID does not exist" containerID="8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"
Oct 30 21:04:49.438841 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.438780    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a"} err="failed to get container status \"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a\": rpc error: code = NotFound desc = could not find container \"8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a\": container with ID starting with 8d1f4aa04a658f80b139693514c2e9d4b2372728c6206ef7369159d5c571bb7a not found: ID does not exist"
Oct 30 21:04:49.515034 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:04:49.514999    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:04:49.639377 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.639343    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 21:04:49.650265 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:49.650242    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc"]
Oct 30 21:04:50.119070 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:50.119037    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" path="/var/lib/kubelet/pods/7e6415dd-c90a-4c98-b68d-d6959d925a04/volumes"
Oct 30 21:04:53.748000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:53.743991    5446 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-qx2lc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.83:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:04:53.748000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:04:53.744066    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qx2lc" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.83:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:05:19.515536 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:05:19.515501    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:05:49.515012 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:05:49.514973    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:06:19.516806 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:06:19.516768    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:06:49.515623 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:06:49.515542    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:07:19.515267 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:07:19.515229    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:07:49.515818 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:07:49.515781    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:08:19.521297 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:08:19.521243    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:08:21.546942 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:08:21.546116    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-wlz59 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:21.546942 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:08:21.546184    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-wlz59" podUID="931ffb02-16c9-49ca-8aad-55a682e64209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:21.603942 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:08:21.601002    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-4pc86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:21.603942 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:08:21.601070    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-4pc86" podUID="c8f1acdf-95cd-41f7-9924-d96419b99562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:49.576120 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:08:49.576082    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:09:17.214153 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.214118    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:09:17.214623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.214533    5446 cpu_manager.go:414] "containerMap: removing container" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery"
Oct 30 21:09:17.214623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.214545    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery"
Oct 30 21:09:17.214623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.214614    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e6415dd-c90a-4c98-b68d-d6959d925a04" containerName="discovery"
Oct 30 21:09:17.217691 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.217673    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.277118 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.277088    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-7919c9-serving-cert\""
Oct 30 21:09:17.295584 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.295551    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvmj\" (UniqueName: \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.295744 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.295643    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.295744 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.295666    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.295875 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.295816    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.324472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.324440    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:09:17.396626 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.396584    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.396812 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.396684    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvmj\" (UniqueName: \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.396812 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.396731    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.396812 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.396759    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.397017 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:09:17.396971    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-serving-cert: secret "maas-api-e2e-worker-single-main-7919c9-serving-cert" not found
Oct 30 21:09:17.397075 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:09:17.397044    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls podName:da3cad1a-0873-46bc-bc43-8f4f0d206026 nodeName:}" failed. No retries permitted until 2026-10-30 21:09:17.897021923 +0000 UTC m=+2523.889025042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls") pod "maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" (UID: "da3cad1a-0873-46bc-bc43-8f4f0d206026") : secret "maas-api-e2e-worker-single-main-7919c9-serving-cert" not found
Oct 30 21:09:17.397278 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.397256    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.399345 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.399327    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.458483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.458446    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvmj\" (UniqueName: \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.901896 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.901849    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:17.904439 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:17.904408    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:18.050638 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.050595    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:09:18.056012 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.055981    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.104040 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.104015    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.104195 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.104177    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnb7\" (UniqueName: \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.112567 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.112541    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:09:18.115539 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.115522    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-7919c9\""
Oct 30 21:09:18.115725 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.115708    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-e2d1a44f-dockercfg-7fbc8\""
Oct 30 21:09:18.131366 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.131344    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:18.205597 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.205560    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnb7\" (UniqueName: \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.205757 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.205654    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.206399 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.206369    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.264241 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.264216    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnb7\" (UniqueName: \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\") pod \"payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.369278 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.369241    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.508463 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.508438    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:09:18.510857 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:09:18.510830    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3cad1a_0873_46bc_bc43_8f4f0d206026.slice/crio-e96e26150e771640a2bdac6c47ba640c43b3331ced1079a859263099db1b0d5d WatchSource:0}: Error finding container e96e26150e771640a2bdac6c47ba640c43b3331ced1079a859263099db1b0d5d: Status 404 returned error can't find the container with id e96e26150e771640a2bdac6c47ba640c43b3331ced1079a859263099db1b0d5d
Oct 30 21:09:18.512146 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.512128    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:09:18.749069 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.749043    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:09:18.751697 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:09:18.751667    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999129c9_c56e_4328_9c09_19269f307e11.slice/crio-1f81c29ff67ddc604ff09c687c7bf3afe7b5bc320d8aff19bc1c52c8114c3e85 WatchSource:0}: Error finding container 1f81c29ff67ddc604ff09c687c7bf3afe7b5bc320d8aff19bc1c52c8114c3e85: Status 404 returned error can't find the container with id 1f81c29ff67ddc604ff09c687c7bf3afe7b5bc320d8aff19bc1c52c8114c3e85
Oct 30 21:09:18.865632 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.865595    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" event={"ID":"999129c9-c56e-4328-9c09-19269f307e11","Type":"ContainerStarted","Data":"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"}
Oct 30 21:09:18.865790 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.865666    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" event={"ID":"999129c9-c56e-4328-9c09-19269f307e11","Type":"ContainerStarted","Data":"1f81c29ff67ddc604ff09c687c7bf3afe7b5bc320d8aff19bc1c52c8114c3e85"}
Oct 30 21:09:18.865790 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.865773    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:18.866811 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:18.866791    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" event={"ID":"da3cad1a-0873-46bc-bc43-8f4f0d206026","Type":"ContainerStarted","Data":"e96e26150e771640a2bdac6c47ba640c43b3331ced1079a859263099db1b0d5d"}
Oct 30 21:09:19.001026 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:19.000971    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" podStartSLOduration=1.000957278 podStartE2EDuration="1.000957278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:18.998739576 +0000 UTC m=+2524.990742702" watchObservedRunningTime="2026-10-30 21:09:19.000957278 +0000 UTC m=+2524.992960423"
Oct 30 21:09:19.515327 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:09:19.515292    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:09:19.874050 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:19.873998    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" event={"ID":"da3cad1a-0873-46bc-bc43-8f4f0d206026","Type":"ContainerStarted","Data":"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"}
Oct 30 21:09:19.874407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:19.874363    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:19.990626 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:19.990579    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" podStartSLOduration=2.205863053 podStartE2EDuration="2.990567018s" totalImagesPullingTime="784.703965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:19.989369693 +0000 UTC m=+2525.981372819" watchObservedRunningTime="2026-10-30 21:09:19.990567018 +0000 UTC m=+2525.982570144"
Oct 30 21:09:25.884592 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:25.884509    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:09:29.877824 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:29.877793    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:09:39.617514 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.617481    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:09:39.620827 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.620810    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.723502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.723468    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-7919c9\"/\"openshift-service-ca.crt\""
Oct 30 21:09:39.723502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.723480    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-7919c9\"/\"kube-root-ca.crt\""
Oct 30 21:09:39.723502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.723502    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-7919c9\"/\"simulator-single-main-7919c9-kserve-self-signed-certs\""
Oct 30 21:09:39.724170 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.724156    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-7919c9\"/\"default-dockercfg-bnw6g\""
Oct 30 21:09:39.726124 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.726101    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:09:39.796407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796370    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.796579 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796434    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ntd\" (UniqueName: \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.796579 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796499    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.796579 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796573    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.796687 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796633    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.796722 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.796703    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.897825 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.897749    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.897825 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.897796    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ntd\" (UniqueName: \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.897825 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.897811    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898126 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.897954    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898126 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.898046    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898126 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.898079    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898299 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.898180    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898299 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.898260    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.898440 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.898408    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.900424 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.900400    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.900611 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.900594    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:39.956518 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:39.956498    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ntd\" (UniqueName: \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\") pod \"simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") " pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:40.231722 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:40.231632    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:40.610424 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:40.610386    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:09:40.612776 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:09:40.612742    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod146ea139_d8b3_4670_a15c_9b885c82ecde.slice/crio-f3a405126ad58e6ba9678b7203b4beefdb4e1c5be0cb2909fa345cfcdefbbad7 WatchSource:0}: Error finding container f3a405126ad58e6ba9678b7203b4beefdb4e1c5be0cb2909fa345cfcdefbbad7: Status 404 returned error can't find the container with id f3a405126ad58e6ba9678b7203b4beefdb4e1c5be0cb2909fa345cfcdefbbad7
Oct 30 21:09:40.973912 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:40.973876    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" event={"ID":"146ea139-d8b3-4670-a15c-9b885c82ecde","Type":"ContainerStarted","Data":"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"}
Oct 30 21:09:40.974318 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:40.973958    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" event={"ID":"146ea139-d8b3-4670-a15c-9b885c82ecde","Type":"ContainerStarted","Data":"f3a405126ad58e6ba9678b7203b4beefdb4e1c5be0cb2909fa345cfcdefbbad7"}
Oct 30 21:09:41.093580 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:41.093532    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" podStartSLOduration=2.093518863 podStartE2EDuration="2.093518863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:41.091340426 +0000 UTC m=+2547.083343554" watchObservedRunningTime="2026-10-30 21:09:41.093518863 +0000 UTC m=+2547.085521989"
Oct 30 21:09:41.231817 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:41.231736    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:49.517643 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:09:49.517601    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:09:50.231811 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:50.231780    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:50.244670 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:50.244638    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:09:51.034968 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:09:51.034938    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:10:19.514292 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:10:19.514258    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:10:42.935309 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:42.935276    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:10:49.514960 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:10:49.514899    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:10:50.076404 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:50.076367    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:10:55.076976 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:55.076842    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing" containerID="cri-o://a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f" gracePeriod=25
Oct 30 21:10:57.082983 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:57.082944    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:10:57.083424 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:57.083161    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" podUID="da3cad1a-0873-46bc-bc43-8f4f0d206026" containerName="maas-api" containerID="cri-o://77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6" gracePeriod=30
Oct 30 21:10:57.956016 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:57.955960    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerName="main" containerID="cri-o://72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171" gracePeriod=45
Oct 30 21:10:58.024959 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.024897    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerName="main" probeResult="failure" output="Get \"https://10.133.0.104:8000/ready\": dial tcp 10.133.0.104:8000: connect: connection refused"
Oct 30 21:10:58.243540 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.243512    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:10:58.316157 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316132    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316258 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316166    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\" (UniqueName: \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316258 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316199    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\" (UniqueName: \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316258 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316231    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316411 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316288    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316477 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316412    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:58.316477 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316462    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\") pod \"146ea139-d8b3-4670-a15c-9b885c82ecde\" (UID: \"146ea139-d8b3-4670-a15c-9b885c82ecde\") "
Oct 30 21:10:58.316584 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316553    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:58.316638 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316577    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:58.316848 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316819    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.316848 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316848    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.317204 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.316864    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.318616 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.318585    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:10:58.318720 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.318686    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:58.318771 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.318721    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd" pod "146ea139-d8b3-4670-a15c-9b885c82ecde" (UID: "146ea139-d8b3-4670-a15c-9b885c82ecde"). InnerVolumeSpecName "kube-api-access-z5ntd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:58.331172 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.331155    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:10:58.353116 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.353091    5446 generic.go:356] "Generic (PLEG): container finished" podID="da3cad1a-0873-46bc-bc43-8f4f0d206026" containerID="77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6" exitCode=0
Oct 30 21:10:58.353209 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.353129    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"
Oct 30 21:10:58.353209 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.353176    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" event={"ID":"da3cad1a-0873-46bc-bc43-8f4f0d206026","Type":"ContainerDied","Data":"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"}
Oct 30 21:10:58.353325 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.353234    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk" event={"ID":"da3cad1a-0873-46bc-bc43-8f4f0d206026","Type":"ContainerDied","Data":"e96e26150e771640a2bdac6c47ba640c43b3331ced1079a859263099db1b0d5d"}
Oct 30 21:10:58.353325 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.353269    5446 scope.go:122] "RemoveContainer" containerID="77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"
Oct 30 21:10:58.354387 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.354367    5446 generic.go:356] "Generic (PLEG): container finished" podID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerID="72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171" exitCode=0
Oct 30 21:10:58.354500 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.354411    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"
Oct 30 21:10:58.354500 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.354455    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" event={"ID":"146ea139-d8b3-4670-a15c-9b885c82ecde","Type":"ContainerDied","Data":"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"}
Oct 30 21:10:58.354500 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.354493    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj" event={"ID":"146ea139-d8b3-4670-a15c-9b885c82ecde","Type":"ContainerDied","Data":"f3a405126ad58e6ba9678b7203b4beefdb4e1c5be0cb2909fa345cfcdefbbad7"}
Oct 30 21:10:58.363170 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.363153    5446 scope.go:122] "RemoveContainer" containerID="77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"
Oct 30 21:10:58.363472 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:10:58.363444    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6\": container with ID starting with 77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6 not found: ID does not exist" containerID="77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"
Oct 30 21:10:58.363619 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.363482    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6"} err="failed to get container status \"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6\": rpc error: code = NotFound desc = could not find container \"77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6\": container with ID starting with 77722d1102a35287d5fc467a685170ddd8402c1aa3e0974d7229027eb49a46c6 not found: ID does not exist"
Oct 30 21:10:58.363619 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.363505    5446 scope.go:122] "RemoveContainer" containerID="72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"
Oct 30 21:10:58.373566 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.373549    5446 scope.go:122] "RemoveContainer" containerID="72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"
Oct 30 21:10:58.373832 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:10:58.373810    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171\": container with ID starting with 72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171 not found: ID does not exist" containerID="72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"
Oct 30 21:10:58.373911 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.373838    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171"} err="failed to get container status \"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171\": rpc error: code = NotFound desc = could not find container \"72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171\": container with ID starting with 72d16be7d6293812a988c5f420d14731dda9e96095f1a3ab7a42ac65ae2ef171 not found: ID does not exist"
Oct 30 21:10:58.417488 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417464    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\") pod \"da3cad1a-0873-46bc-bc43-8f4f0d206026\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") "
Oct 30 21:10:58.417620 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417518    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\" (UniqueName: \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\") pod \"da3cad1a-0873-46bc-bc43-8f4f0d206026\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") "
Oct 30 21:10:58.417620 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417544    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") pod \"da3cad1a-0873-46bc-bc43-8f4f0d206026\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") "
Oct 30 21:10:58.417620 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417579    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\") pod \"da3cad1a-0873-46bc-bc43-8f4f0d206026\" (UID: \"da3cad1a-0873-46bc-bc43-8f4f0d206026\") "
Oct 30 21:10:58.417868 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417841    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca" pod "da3cad1a-0873-46bc-bc43-8f4f0d206026" (UID: "da3cad1a-0873-46bc-bc43-8f4f0d206026"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:10:58.417951 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417848    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146ea139-d8b3-4670-a15c-9b885c82ecde-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.417951 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417903    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5ntd\" (UniqueName: \"kubernetes.io/projected/146ea139-d8b3-4670-a15c-9b885c82ecde-kube-api-access-z5ntd\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.417951 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.417934    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146ea139-d8b3-4670-a15c-9b885c82ecde-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.419703 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.419680    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls" pod "da3cad1a-0873-46bc-bc43-8f4f0d206026" (UID: "da3cad1a-0873-46bc-bc43-8f4f0d206026"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:10:58.419817 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.419801    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs" pod "da3cad1a-0873-46bc-bc43-8f4f0d206026" (UID: "da3cad1a-0873-46bc-bc43-8f4f0d206026"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:10:58.420311 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.420293    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj" pod "da3cad1a-0873-46bc-bc43-8f4f0d206026" (UID: "da3cad1a-0873-46bc-bc43-8f4f0d206026"). InnerVolumeSpecName "kube-api-access-sdvmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:58.518876 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.518800    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdvmj\" (UniqueName: \"kubernetes.io/projected/da3cad1a-0873-46bc-bc43-8f4f0d206026-kube-api-access-sdvmj\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.518876 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.518830    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.518876 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.518844    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da3cad1a-0873-46bc-bc43-8f4f0d206026-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.518876 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.518856    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3cad1a-0873-46bc-bc43-8f4f0d206026-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:58.639317 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.639289    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:10:58.644797 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.644774    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-7919c9/simulator-single-main-7919c9-kserve-7cb975c7c6-r8dpj"]
Oct 30 21:10:58.774421 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.774352    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:10:58.779419 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:58.779399    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7919c9-5cb777c4b8-zs5lk"]
Oct 30 21:10:59.875326 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:10:59.875286    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:11:00.119199 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:00.119161    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" path="/var/lib/kubelet/pods/146ea139-d8b3-4670-a15c-9b885c82ecde/volumes"
Oct 30 21:11:00.119631 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:00.119616    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da3cad1a-0873-46bc-bc43-8f4f0d206026" path="/var/lib/kubelet/pods/da3cad1a-0873-46bc-bc43-8f4f0d206026/volumes"
Oct 30 21:11:09.875550 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:09.875515    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:11:15.326459 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.326434    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:11:15.449510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.449430    5446 generic.go:356] "Generic (PLEG): container finished" podID="999129c9-c56e-4328-9c09-19269f307e11" containerID="a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f" exitCode=0
Oct 30 21:11:15.449510 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.449479    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"
Oct 30 21:11:15.449714 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.449517    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" event={"ID":"999129c9-c56e-4328-9c09-19269f307e11","Type":"ContainerDied","Data":"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"}
Oct 30 21:11:15.449714 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.449576    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6" event={"ID":"999129c9-c56e-4328-9c09-19269f307e11","Type":"ContainerDied","Data":"1f81c29ff67ddc604ff09c687c7bf3afe7b5bc320d8aff19bc1c52c8114c3e85"}
Oct 30 21:11:15.449714 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.449607    5446 scope.go:122] "RemoveContainer" containerID="a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"
Oct 30 21:11:15.458274 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.458255    5446 scope.go:122] "RemoveContainer" containerID="a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"
Oct 30 21:11:15.458563 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:11:15.458544    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f\": container with ID starting with a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f not found: ID does not exist" containerID="a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"
Oct 30 21:11:15.458625 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.458572    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f"} err="failed to get container status \"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f\": rpc error: code = NotFound desc = could not find container \"a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f\": container with ID starting with a6d45f2675a80c8579d834f41ac6449acf6d4e6c5aa4fc76421f930776ee311f not found: ID does not exist"
Oct 30 21:11:15.464984 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.464908    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\") pod \"999129c9-c56e-4328-9c09-19269f307e11\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") "
Oct 30 21:11:15.465091 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.465017    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\" (UniqueName: \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\") pod \"999129c9-c56e-4328-9c09-19269f307e11\" (UID: \"999129c9-c56e-4328-9c09-19269f307e11\") "
Oct 30 21:11:15.465280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.465257    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume" pod "999129c9-c56e-4328-9c09-19269f307e11" (UID: "999129c9-c56e-4328-9c09-19269f307e11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:11:15.467156 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.467129    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7" pod "999129c9-c56e-4328-9c09-19269f307e11" (UID: "999129c9-c56e-4328-9c09-19269f307e11"). InnerVolumeSpecName "kube-api-access-rpnb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:11:15.566570 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.566541    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/999129c9-c56e-4328-9c09-19269f307e11-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:11:15.566570 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.566566    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpnb7\" (UniqueName: \"kubernetes.io/projected/999129c9-c56e-4328-9c09-19269f307e11-kube-api-access-rpnb7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:11:15.870244 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.870217    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:11:15.919627 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:15.919593    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-7919c9-846d996796fpr6"]
Oct 30 21:11:16.118566 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:11:16.118537    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="999129c9-c56e-4328-9c09-19269f307e11" path="/var/lib/kubelet/pods/999129c9-c56e-4328-9c09-19269f307e11/volumes"
Oct 30 21:11:19.515810 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:11:19.515767    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:11:49.515077 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:11:49.515027    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:12:19.516283 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:12:19.516244    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:12:49.515048 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:12:49.514974    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:13:17.826943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:17.821006    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:13:17.826943 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:17.821089    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:13:19.515563 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:13:19.515524    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:13:48.294438 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294402    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294787    5446 cpu_manager.go:414] "containerMap: removing container" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294797    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294811    5446 cpu_manager.go:414] "containerMap: removing container" podUID="da3cad1a-0873-46bc-bc43-8f4f0d206026" containerName="maas-api"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294816    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da3cad1a-0873-46bc-bc43-8f4f0d206026" containerName="maas-api"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294854    5446 cpu_manager.go:414] "containerMap: removing container" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerName="main"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294859    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerName="main"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294934    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="999129c9-c56e-4328-9c09-19269f307e11" containerName="payload-processing"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294943    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="da3cad1a-0873-46bc-bc43-8f4f0d206026" containerName="maas-api"
Oct 30 21:13:48.294972 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.294954    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="146ea139-d8b3-4670-a15c-9b885c82ecde" containerName="main"
Oct 30 21:13:48.297830 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.297815    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.354351 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.354326    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:13:48.402117 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.402088    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-dba0a6\""
Oct 30 21:13:48.402316 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.402126    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-49b2b43d-dockercfg-mnhpt\""
Oct 30 21:13:48.433123 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.433093    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.433261 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.433147    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6rv\" (UniqueName: \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.454240 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.454210    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:13:48.457802 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.457785    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.514678 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.514643    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:13:48.534000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.533975    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.534139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.534036    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6rv\" (UniqueName: \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.534612 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.534590    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.592351 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.592298    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6rv\" (UniqueName: \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\") pod \"payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.610160 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.610137    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:48.635099 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.635077    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.635204 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.635123    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmck\" (UniqueName: \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.736595 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.736564    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.736735 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.736669    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmck\" (UniqueName: \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.737299 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.737278    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.794425 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.794397    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmck\" (UniqueName: \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\") pod \"payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:48.981775 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:48.981751    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:13:48.984224 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:13:48.984200    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93930f9_926d_4114_9eb3_b10a5a8a8679.slice/crio-79adfa797a65dd3fb22791df3ed0ae21bff45f8efafd21c55aec462738b173bf WatchSource:0}: Error finding container 79adfa797a65dd3fb22791df3ed0ae21bff45f8efafd21c55aec462738b173bf: Status 404 returned error can't find the container with id 79adfa797a65dd3fb22791df3ed0ae21bff45f8efafd21c55aec462738b173bf
Oct 30 21:13:49.071487 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:49.071461    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:49.215967 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:49.215930    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" event={"ID":"f93930f9-926d-4114-9eb3-b10a5a8a8679","Type":"ContainerStarted","Data":"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"}
Oct 30 21:13:49.216138 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:49.215985    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" event={"ID":"f93930f9-926d-4114-9eb3-b10a5a8a8679","Type":"ContainerStarted","Data":"79adfa797a65dd3fb22791df3ed0ae21bff45f8efafd21c55aec462738b173bf"}
Oct 30 21:13:49.330284 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:49.330187    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" podStartSLOduration=1.330173035 podStartE2EDuration="1.330173035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:13:49.328965355 +0000 UTC m=+2795.320968483" watchObservedRunningTime="2026-10-30 21:13:49.330173035 +0000 UTC m=+2795.322176162"
Oct 30 21:13:49.447239 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:49.447215    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:13:49.449779 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:13:49.449749    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17091dbf_4b69_475d_b387_cd58de5ce7bf.slice/crio-159cabcaa0f3ccfd71f447fc142c176dac5d10da4704a2ccceb65c83309939f9 WatchSource:0}: Error finding container 159cabcaa0f3ccfd71f447fc142c176dac5d10da4704a2ccceb65c83309939f9: Status 404 returned error can't find the container with id 159cabcaa0f3ccfd71f447fc142c176dac5d10da4704a2ccceb65c83309939f9
Oct 30 21:13:49.516197 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:13:49.516163    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:13:50.221757 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:50.221723    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" event={"ID":"17091dbf-4b69-475d-b387-cd58de5ce7bf","Type":"ContainerStarted","Data":"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"}
Oct 30 21:13:50.221757 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:50.221772    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" event={"ID":"17091dbf-4b69-475d-b387-cd58de5ce7bf","Type":"ContainerStarted","Data":"159cabcaa0f3ccfd71f447fc142c176dac5d10da4704a2ccceb65c83309939f9"}
Oct 30 21:13:50.222045 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:50.221937    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:13:50.222119 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:50.222093    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:13:50.336376 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:50.336328    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" podStartSLOduration=2.336314165 podStartE2EDuration="2.336314165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:13:50.335631344 +0000 UTC m=+2796.327634472" watchObservedRunningTime="2026-10-30 21:13:50.336314165 +0000 UTC m=+2796.328317291"
Oct 30 21:13:51.014087 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.014053    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:13:51.017663 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.017644    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.070645 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.070620    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-dba0a6-serving-cert\""
Oct 30 21:13:51.121361 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.121332    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:13:51.157252 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.157219    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.157446 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.157422    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsmhn\" (UniqueName: \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.157495 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.157470    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.157655 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.157561    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.258831 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.258797    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsmhn\" (UniqueName: \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.259037 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.258834    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.259037 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.258875    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.259037 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.258973    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.259719 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.259693    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.261399 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.261372    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.261731 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.261710    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.318953 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.318867    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsmhn\" (UniqueName: \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\") pod \"maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.332225 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.331961    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:51.704683 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:51.704660    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:13:51.707328 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:13:51.707301    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b314a8b_2fb9_494b_b753_c35ece48e46d.slice/crio-1dd591134fc6d0b377cdf247e7a7f14a7ce7f6e8544a1729047285d904895c63 WatchSource:0}: Error finding container 1dd591134fc6d0b377cdf247e7a7f14a7ce7f6e8544a1729047285d904895c63: Status 404 returned error can't find the container with id 1dd591134fc6d0b377cdf247e7a7f14a7ce7f6e8544a1729047285d904895c63
Oct 30 21:13:52.232385 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:52.232311    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" event={"ID":"5b314a8b-2fb9-494b-b753-c35ece48e46d","Type":"ContainerStarted","Data":"1dd591134fc6d0b377cdf247e7a7f14a7ce7f6e8544a1729047285d904895c63"}
Oct 30 21:13:53.240882 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:53.240847    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" event={"ID":"5b314a8b-2fb9-494b-b753-c35ece48e46d","Type":"ContainerStarted","Data":"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"}
Oct 30 21:13:53.241302 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:53.240967    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:13:53.357853 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:53.357801    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" podStartSLOduration=2.5333975669999997 podStartE2EDuration="3.35778875s" totalImagesPullingTime="824.391183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:13:53.355377239 +0000 UTC m=+2799.347380357" watchObservedRunningTime="2026-10-30 21:13:53.35778875 +0000 UTC m=+2799.349791877"
Oct 30 21:13:59.251045 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:13:59.251014    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:14:01.228986 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:01.228957    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:14:01.229437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:01.229147    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:14:13.175819 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.175783    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:14:13.179454 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.179434    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.246601 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.246571    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:14:13.261535 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261512    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.261649 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261558    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.261649 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261584    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.261727 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261684    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t279\" (UniqueName: \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.261762 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261728    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.261832 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.261815    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.283178 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.283157    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-dba0a6\"/\"kube-root-ca.crt\""
Oct 30 21:14:13.283506 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.283455    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-dba0a6\"/\"simulator-single-main-dba0a6-kserve-self-signed-certs\""
Oct 30 21:14:13.283506 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.283471    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-dba0a6\"/\"openshift-service-ca.crt\""
Oct 30 21:14:13.283506 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.283482    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-dba0a6\"/\"default-dockercfg-5wwzn\""
Oct 30 21:14:13.363251 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363203    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363400 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363269    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363400 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363311    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363400 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363353    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t279\" (UniqueName: \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363574 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363398    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363631 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363584    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363811 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363789    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.363891 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.363820    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.364212 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.364189    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.365829 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.365800    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.366053 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.366034    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.421270 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.421247    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t279\" (UniqueName: \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\") pod \"simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") " pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.490977 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.490903    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:13.867402 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:13.867378    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:14:13.870017 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:14:13.869981    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77d20236_a581_4ab5_aa7f_b5325fb9af13.slice/crio-fcdbf8916d62e5ba04051f3ecd48ea33ec6d75c0dd2713e9fded2fe554aff146 WatchSource:0}: Error finding container fcdbf8916d62e5ba04051f3ecd48ea33ec6d75c0dd2713e9fded2fe554aff146: Status 404 returned error can't find the container with id fcdbf8916d62e5ba04051f3ecd48ea33ec6d75c0dd2713e9fded2fe554aff146
Oct 30 21:14:14.344648 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:14.344565    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" event={"ID":"77d20236-a581-4ab5-aa7f-b5325fb9af13","Type":"ContainerStarted","Data":"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"}
Oct 30 21:14:14.344648 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:14.344607    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" event={"ID":"77d20236-a581-4ab5-aa7f-b5325fb9af13","Type":"ContainerStarted","Data":"fcdbf8916d62e5ba04051f3ecd48ea33ec6d75c0dd2713e9fded2fe554aff146"}
Oct 30 21:14:14.462273 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:14.462226    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" podStartSLOduration=1.462211588 podStartE2EDuration="1.462211588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:14.45952368 +0000 UTC m=+2820.451526807" watchObservedRunningTime="2026-10-30 21:14:14.462211588 +0000 UTC m=+2820.454214714"
Oct 30 21:14:14.491536 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:14.491508    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:19.515845 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:14:19.515804    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:14:23.491224 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:23.491190    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:23.503546 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:23.503513    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:24.403293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:14:24.403261    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:14:49.516092 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:14:49.516056    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:15:14.373210 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:14.373176    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:15:19.514745 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:19.514706    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:15:20.393379 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:20.393341    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:15:20.394134 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:20.394005    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" podUID="5b314a8b-2fb9-494b-b753-c35ece48e46d" containerName="maas-api" containerID="cri-o://48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60" gracePeriod=30
Oct 30 21:15:20.866856 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:20.866824    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:15:20.922608 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:20.922583    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:15:21.655424 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.655401    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:15:21.670725 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.670700    5446 generic.go:356] "Generic (PLEG): container finished" podID="5b314a8b-2fb9-494b-b753-c35ece48e46d" containerID="48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60" exitCode=0
Oct 30 21:15:21.670843 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.670735    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" event={"ID":"5b314a8b-2fb9-494b-b753-c35ece48e46d","Type":"ContainerDied","Data":"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"}
Oct 30 21:15:21.670843 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.670783    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5" event={"ID":"5b314a8b-2fb9-494b-b753-c35ece48e46d","Type":"ContainerDied","Data":"1dd591134fc6d0b377cdf247e7a7f14a7ce7f6e8544a1729047285d904895c63"}
Oct 30 21:15:21.670843 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.670748    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"
Oct 30 21:15:21.670994 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.670796    5446 scope.go:122] "RemoveContainer" containerID="48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"
Oct 30 21:15:21.679619 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.679602    5446 scope.go:122] "RemoveContainer" containerID="48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"
Oct 30 21:15:21.679898 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:21.679879    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60\": container with ID starting with 48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60 not found: ID does not exist" containerID="48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"
Oct 30 21:15:21.679994 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.679903    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60"} err="failed to get container status \"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60\": rpc error: code = NotFound desc = could not find container \"48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60\": container with ID starting with 48a4587e4d9add026615ca1577838cba41fe60330d85cd969d2e204e18cc2e60 not found: ID does not exist"
Oct 30 21:15:21.792280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792215    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\" (UniqueName: \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\") pod \"5b314a8b-2fb9-494b-b753-c35ece48e46d\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") "
Oct 30 21:15:21.792280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792260    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\") pod \"5b314a8b-2fb9-494b-b753-c35ece48e46d\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") "
Oct 30 21:15:21.792484 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792378    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\") pod \"5b314a8b-2fb9-494b-b753-c35ece48e46d\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") "
Oct 30 21:15:21.792484 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792425    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\") pod \"5b314a8b-2fb9-494b-b753-c35ece48e46d\" (UID: \"5b314a8b-2fb9-494b-b753-c35ece48e46d\") "
Oct 30 21:15:21.792686 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792652    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca" pod "5b314a8b-2fb9-494b-b753-c35ece48e46d" (UID: "5b314a8b-2fb9-494b-b753-c35ece48e46d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:21.792856 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.792822    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b314a8b-2fb9-494b-b753-c35ece48e46d-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:21.794687 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.794643    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs" pod "5b314a8b-2fb9-494b-b753-c35ece48e46d" (UID: "5b314a8b-2fb9-494b-b753-c35ece48e46d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:21.794823 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.794799    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn" pod "5b314a8b-2fb9-494b-b753-c35ece48e46d" (UID: "5b314a8b-2fb9-494b-b753-c35ece48e46d"). InnerVolumeSpecName "kube-api-access-wsmhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:21.795129 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.795109    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls" pod "5b314a8b-2fb9-494b-b753-c35ece48e46d" (UID: "5b314a8b-2fb9-494b-b753-c35ece48e46d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:21.893434 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.893408    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsmhn\" (UniqueName: \"kubernetes.io/projected/5b314a8b-2fb9-494b-b753-c35ece48e46d-kube-api-access-wsmhn\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:21.893434 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.893434    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:21.893770 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:21.893444    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b314a8b-2fb9-494b-b753-c35ece48e46d-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:22.092053 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:22.091995    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:15:22.096850 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:22.096824    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-dba0a6-68bf9f7f46-mcqp5"]
Oct 30 21:15:22.120239 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:22.120212    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b314a8b-2fb9-494b-b753-c35ece48e46d" path="/var/lib/kubelet/pods/5b314a8b-2fb9-494b-b753-c35ece48e46d/volumes"
Oct 30 21:15:25.867500 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:25.867456    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing" containerID="cri-o://250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171" gracePeriod=25
Oct 30 21:15:25.923104 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:25.923037    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing" containerID="cri-o://812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731" gracePeriod=25
Oct 30 21:15:29.393424 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.393379    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerName="main" containerID="cri-o://684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98" gracePeriod=45
Oct 30 21:15:29.397521 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.397491    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerName="main" probeResult="failure" output="Get \"https://10.133.0.108:8000/ready\": EOF"
Oct 30 21:15:29.645179 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.645126    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:15:29.656395 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656373    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\" (UniqueName: \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656413    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656442    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656460    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656613 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656477    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656613 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656536    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\" (UniqueName: \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\") pod \"77d20236-a581-4ab5-aa7f-b5325fb9af13\" (UID: \"77d20236-a581-4ab5-aa7f-b5325fb9af13\") "
Oct 30 21:15:29.656760 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656729    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:29.656864 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656813    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:29.656864 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656822    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:29.657008 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656911    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.657008 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656945    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.657008 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.656982    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.658956 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.658933    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "kube-api-access-2t279". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:29.659091 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.659073    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:29.659134 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.659096    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs" pod "77d20236-a581-4ab5-aa7f-b5325fb9af13" (UID: "77d20236-a581-4ab5-aa7f-b5325fb9af13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:29.710040 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.710015    5446 generic.go:356] "Generic (PLEG): container finished" podID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerID="684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98" exitCode=0
Oct 30 21:15:29.710139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.710051    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" event={"ID":"77d20236-a581-4ab5-aa7f-b5325fb9af13","Type":"ContainerDied","Data":"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"}
Oct 30 21:15:29.710139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.710061    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"
Oct 30 21:15:29.710139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.710096    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc" event={"ID":"77d20236-a581-4ab5-aa7f-b5325fb9af13","Type":"ContainerDied","Data":"fcdbf8916d62e5ba04051f3ecd48ea33ec6d75c0dd2713e9fded2fe554aff146"}
Oct 30 21:15:29.710139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.710115    5446 scope.go:122] "RemoveContainer" containerID="684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"
Oct 30 21:15:29.718989 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.718972    5446 scope.go:122] "RemoveContainer" containerID="684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"
Oct 30 21:15:29.719243 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:29.719220    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98\": container with ID starting with 684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98 not found: ID does not exist" containerID="684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"
Oct 30 21:15:29.719292 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.719251    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98"} err="failed to get container status \"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98\": rpc error: code = NotFound desc = could not find container \"684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98\": container with ID starting with 684ab566e79d21d1f1a1d4a3ea6bc6addad037b91893034f05bfd45e08d7eb98 not found: ID does not exist"
Oct 30 21:15:29.758170 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.758147    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t279\" (UniqueName: \"kubernetes.io/projected/77d20236-a581-4ab5-aa7f-b5325fb9af13-kube-api-access-2t279\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.758170 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.758168    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d20236-a581-4ab5-aa7f-b5325fb9af13-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.758328 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.758178    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77d20236-a581-4ab5-aa7f-b5325fb9af13-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:29.869475 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.869436    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:15:29.874755 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:29.874733    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-dba0a6/simulator-single-main-dba0a6-kserve-5cd86f849d-hxkfc"]
Oct 30 21:15:30.119097 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:30.119073    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" path="/var/lib/kubelet/pods/77d20236-a581-4ab5-aa7f-b5325fb9af13/volumes"
Oct 30 21:15:31.228241 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:31.228207    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:31.228241 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:31.228218    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:40.948022 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.947985    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:15:40.948410 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948389    5446 cpu_manager.go:414] "containerMap: removing container" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerName="main"
Oct 30 21:15:40.948410 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948400    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerName="main"
Oct 30 21:15:40.948483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948418    5446 cpu_manager.go:414] "containerMap: removing container" podUID="5b314a8b-2fb9-494b-b753-c35ece48e46d" containerName="maas-api"
Oct 30 21:15:40.948483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948424    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b314a8b-2fb9-494b-b753-c35ece48e46d" containerName="maas-api"
Oct 30 21:15:40.948545 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948489    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="77d20236-a581-4ab5-aa7f-b5325fb9af13" containerName="main"
Oct 30 21:15:40.948545 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.948501    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b314a8b-2fb9-494b-b753-c35ece48e46d" containerName="maas-api"
Oct 30 21:15:40.951469 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:40.951453    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.055492 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.055467    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-162c600a-kserve-self-signed-certs\""
Oct 30 21:15:41.056885 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.056863    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:15:41.059974 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.059952    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.060091 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.059994    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.060091 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.060030    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkcg\" (UniqueName: \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.060193 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.060122    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.060231 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.060220    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.060271 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.060253    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.161797 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.161754    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162027 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.161812    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162027 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.161843    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkcg\" (UniqueName: \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162027 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.161879    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162027 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.161992    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162243 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.162035    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162566 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.162535    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162671 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.162597    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.162671 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.162609    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.164710 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.164680    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.164795 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.164775    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.219183 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.219132    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkcg\" (UniqueName: \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\") pod \"e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") " pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.227948 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.227906    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:41.228051 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.227929    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:41.263085 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.263065    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:41.639978 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.639950    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:15:41.642447 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:15:41.642411    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61d706a3_c992_43cc_b73c_9dabf56214e5.slice/crio-d81db9edebccd92ae1d5d442c02f9119f9361337dabc71ddf760289fe23587f6 WatchSource:0}: Error finding container d81db9edebccd92ae1d5d442c02f9119f9361337dabc71ddf760289fe23587f6: Status 404 returned error can't find the container with id d81db9edebccd92ae1d5d442c02f9119f9361337dabc71ddf760289fe23587f6
Oct 30 21:15:41.768240 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.768205    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" event={"ID":"61d706a3-c992-43cc-b73c-9dabf56214e5","Type":"ContainerStarted","Data":"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"}
Oct 30 21:15:41.768382 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.768249    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" event={"ID":"61d706a3-c992-43cc-b73c-9dabf56214e5","Type":"ContainerStarted","Data":"d81db9edebccd92ae1d5d442c02f9119f9361337dabc71ddf760289fe23587f6"}
Oct 30 21:15:41.883847 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:41.883780    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" podStartSLOduration=1.8837596589999999 podStartE2EDuration="1.883759659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:41.883299806 +0000 UTC m=+2907.875302932" watchObservedRunningTime="2026-10-30 21:15:41.883759659 +0000 UTC m=+2907.875762786"
Oct 30 21:15:42.263661 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:42.263627    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:46.250414 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.250379    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:15:46.297584 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.297554    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:15:46.311173 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.311137    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\") pod \"17091dbf-4b69-475d-b387-cd58de5ce7bf\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") "
Oct 30 21:15:46.311325 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.311201    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\" (UniqueName: \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\") pod \"17091dbf-4b69-475d-b387-cd58de5ce7bf\" (UID: \"17091dbf-4b69-475d-b387-cd58de5ce7bf\") "
Oct 30 21:15:46.311611 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.311581    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume" pod "17091dbf-4b69-475d-b387-cd58de5ce7bf" (UID: "17091dbf-4b69-475d-b387-cd58de5ce7bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:46.311723 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.311680    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17091dbf-4b69-475d-b387-cd58de5ce7bf-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:46.313973 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.313945    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck" pod "17091dbf-4b69-475d-b387-cd58de5ce7bf" (UID: "17091dbf-4b69-475d-b387-cd58de5ce7bf"). InnerVolumeSpecName "kube-api-access-rzmck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:46.412725 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.412678    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\") pod \"f93930f9-926d-4114-9eb3-b10a5a8a8679\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") "
Oct 30 21:15:46.412899 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.412840    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\" (UniqueName: \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\") pod \"f93930f9-926d-4114-9eb3-b10a5a8a8679\" (UID: \"f93930f9-926d-4114-9eb3-b10a5a8a8679\") "
Oct 30 21:15:46.413133 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.413104    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume" pod "f93930f9-926d-4114-9eb3-b10a5a8a8679" (UID: "f93930f9-926d-4114-9eb3-b10a5a8a8679"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:46.413280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.413265    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzmck\" (UniqueName: \"kubernetes.io/projected/17091dbf-4b69-475d-b387-cd58de5ce7bf-kube-api-access-rzmck\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:46.413355 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.413282    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f93930f9-926d-4114-9eb3-b10a5a8a8679-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:46.415261 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.415227    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv" pod "f93930f9-926d-4114-9eb3-b10a5a8a8679" (UID: "f93930f9-926d-4114-9eb3-b10a5a8a8679"). InnerVolumeSpecName "kube-api-access-9m6rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:46.514593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.514493    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m6rv\" (UniqueName: \"kubernetes.io/projected/f93930f9-926d-4114-9eb3-b10a5a8a8679-kube-api-access-9m6rv\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:46.794362 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.794265    5446 generic.go:356] "Generic (PLEG): container finished" podID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerID="812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731" exitCode=0
Oct 30 21:15:46.794362 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.794309    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" event={"ID":"f93930f9-926d-4114-9eb3-b10a5a8a8679","Type":"ContainerDied","Data":"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"}
Oct 30 21:15:46.794595 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.794395    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh" event={"ID":"f93930f9-926d-4114-9eb3-b10a5a8a8679","Type":"ContainerDied","Data":"79adfa797a65dd3fb22791df3ed0ae21bff45f8efafd21c55aec462738b173bf"}
Oct 30 21:15:46.794595 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.794323    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"
Oct 30 21:15:46.794595 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.794433    5446 scope.go:122] "RemoveContainer" containerID="812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"
Oct 30 21:15:46.796458 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.796435    5446 generic.go:356] "Generic (PLEG): container finished" podID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerID="250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171" exitCode=0
Oct 30 21:15:46.796585 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.796490    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"
Oct 30 21:15:46.796585 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.796523    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" event={"ID":"17091dbf-4b69-475d-b387-cd58de5ce7bf","Type":"ContainerDied","Data":"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"}
Oct 30 21:15:46.796585 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.796563    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m" event={"ID":"17091dbf-4b69-475d-b387-cd58de5ce7bf","Type":"ContainerDied","Data":"159cabcaa0f3ccfd71f447fc142c176dac5d10da4704a2ccceb65c83309939f9"}
Oct 30 21:15:46.806554 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.806501    5446 scope.go:122] "RemoveContainer" containerID="812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"
Oct 30 21:15:46.806823 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:46.806801    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731\": container with ID starting with 812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731 not found: ID does not exist" containerID="812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"
Oct 30 21:15:46.806901 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.806831    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731"} err="failed to get container status \"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731\": rpc error: code = NotFound desc = could not find container \"812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731\": container with ID starting with 812d87352ed1c2ecc55bcf9636f790c42f8e2d75f0acefaae689459d90bae731 not found: ID does not exist"
Oct 30 21:15:46.806901 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.806853    5446 scope.go:122] "RemoveContainer" containerID="250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"
Oct 30 21:15:46.818953 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.818910    5446 scope.go:122] "RemoveContainer" containerID="250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"
Oct 30 21:15:46.819302 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:46.819270    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171\": container with ID starting with 250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171 not found: ID does not exist" containerID="250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"
Oct 30 21:15:46.819376 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.819315    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171"} err="failed to get container status \"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171\": rpc error: code = NotFound desc = could not find container \"250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171\": container with ID starting with 250b392e69d523f8e3d503515ca33a88b03d38567795308c480f339db16cb171 not found: ID does not exist"
Oct 30 21:15:46.961092 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:46.961057    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:15:47.059994 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:47.047540    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-dba0a6-679dfmc9kh"]
Oct 30 21:15:47.086194 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:47.086166    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:15:47.095938 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:47.094985    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-dba0a6-bd7f5c768fw79m"]
Oct 30 21:15:48.146940 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:48.146543    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" path="/var/lib/kubelet/pods/17091dbf-4b69-475d-b387-cd58de5ce7bf/volumes"
Oct 30 21:15:48.147466 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:48.147141    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" path="/var/lib/kubelet/pods/f93930f9-926d-4114-9eb3-b10a5a8a8679/volumes"
Oct 30 21:15:49.514935 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:15:49.514889    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:15:51.264103 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:51.264075    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:51.277645 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:51.277626    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:15:51.906692 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:15:51.906661    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:16:19.515231 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:16:19.515195    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:16:25.332435 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332408    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332791    5446 cpu_manager.go:414] "containerMap: removing container" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing"
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332802    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing"
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332833    5446 cpu_manager.go:414] "containerMap: removing container" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing"
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332838    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing"
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332901    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="f93930f9-926d-4114-9eb3-b10a5a8a8679" containerName="payload-pre-processing"
Oct 30 21:16:25.333000 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.332911    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="17091dbf-4b69-475d-b387-cd58de5ce7bf" containerName="payload-processing"
Oct 30 21:16:25.337220 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.337201    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382406 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382371    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382525 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382481    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382568 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382529    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kfls\" (UniqueName: \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382568 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382549    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382819 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382568    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.382819 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.382595    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.440770 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.440738    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-162c600a-kserve-self-signed-certs\""
Oct 30 21:16:25.442513 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.442492    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:16:25.483484 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483439    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.483657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483533    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kfls\" (UniqueName: \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.483657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483578    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.483657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483614    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.483657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483653    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.483856 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.483730    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.484189 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.484163    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.484410 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.484387    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.484754 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.484730    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.492238 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.492209    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.492490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.492468    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.543279 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.543252    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kfls\" (UniqueName: \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\") pod \"e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") " pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:25.648434 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:25.648399    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:26.020386 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:26.020283    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:16:26.023113 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:16:26.023083    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1e7a1c2_4902_4a72_be91_967084841ad8.slice/crio-cc6863da7834b48010c747b6c14f96eb85764b131c6f4b49ad1a7c123c47d702 WatchSource:0}: Error finding container cc6863da7834b48010c747b6c14f96eb85764b131c6f4b49ad1a7c123c47d702: Status 404 returned error can't find the container with id cc6863da7834b48010c747b6c14f96eb85764b131c6f4b49ad1a7c123c47d702
Oct 30 21:16:26.078974 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:26.078948    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" event={"ID":"a1e7a1c2-4902-4a72-be91-967084841ad8","Type":"ContainerStarted","Data":"cc6863da7834b48010c747b6c14f96eb85764b131c6f4b49ad1a7c123c47d702"}
Oct 30 21:16:27.085751 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:27.085692    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" event={"ID":"a1e7a1c2-4902-4a72-be91-967084841ad8","Type":"ContainerStarted","Data":"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"}
Oct 30 21:16:27.204080 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:27.204031    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" podStartSLOduration=2.204016774 podStartE2EDuration="2.204016774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:27.20183339 +0000 UTC m=+2953.193836516" watchObservedRunningTime="2026-10-30 21:16:27.204016774 +0000 UTC m=+2953.196019902"
Oct 30 21:16:27.649289 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:27.649261    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:32.826054 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:32.826018    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:16:32.826659 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:32.826628    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:16:35.648958 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:35.648908    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:35.660876 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:35.660848    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:36.199254 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:16:36.199223    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:16:49.516195 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:16:49.516159    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:17:10.070141 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:10.070110    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:17:19.514993 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:17:19.514949    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:17:25.090678 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.090636    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" podUID="61d706a3-c992-43cc-b73c-9dabf56214e5" containerName="main" containerID="cri-o://803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c" gracePeriod=45
Oct 30 21:17:25.344472 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.344422    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:17:25.499051 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.499023    5446 generic.go:356] "Generic (PLEG): container finished" podID="61d706a3-c992-43cc-b73c-9dabf56214e5" containerID="803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c" exitCode=0
Oct 30 21:17:25.499203 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.499068    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"
Oct 30 21:17:25.499203 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.499086    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" event={"ID":"61d706a3-c992-43cc-b73c-9dabf56214e5","Type":"ContainerDied","Data":"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"}
Oct 30 21:17:25.499203 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.499124    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t" event={"ID":"61d706a3-c992-43cc-b73c-9dabf56214e5","Type":"ContainerDied","Data":"d81db9edebccd92ae1d5d442c02f9119f9361337dabc71ddf760289fe23587f6"}
Oct 30 21:17:25.499203 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.499145    5446 scope.go:122] "RemoveContainer" containerID="803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"
Oct 30 21:17:25.508031 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.508014    5446 scope.go:122] "RemoveContainer" containerID="803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"
Oct 30 21:17:25.508284 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:17:25.508265    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c\": container with ID starting with 803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c not found: ID does not exist" containerID="803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"
Oct 30 21:17:25.508337 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.508294    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c"} err="failed to get container status \"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c\": rpc error: code = NotFound desc = could not find container \"803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c\": container with ID starting with 803cc741043681e9c4b9334268f6f336adb040a80fe0767d9bfd770fb1f7f23c not found: ID does not exist"
Oct 30 21:17:25.509518 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509503    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.509566 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509556    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.509607 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509601    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\" (UniqueName: \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.509653 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509633    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\" (UniqueName: \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.509740 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509723    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:25.509833 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509817    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.509898 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509835    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:25.509898 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.509844    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\") pod \"61d706a3-c992-43cc-b73c-9dabf56214e5\" (UID: \"61d706a3-c992-43cc-b73c-9dabf56214e5\") "
Oct 30 21:17:25.510119 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.510098    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:25.510290 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.510275    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.510356 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.510292    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.510356 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.510300    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.511868 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.511844    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:25.511987 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.511959    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:25.512068 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.512052    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg" pod "61d706a3-c992-43cc-b73c-9dabf56214e5" (UID: "61d706a3-c992-43cc-b73c-9dabf56214e5"). InnerVolumeSpecName "kube-api-access-smkcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:25.611110 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.611091    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d706a3-c992-43cc-b73c-9dabf56214e5-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.611194 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.611111    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d706a3-c992-43cc-b73c-9dabf56214e5-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.611194 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.611120    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smkcg\" (UniqueName: \"kubernetes.io/projected/61d706a3-c992-43cc-b73c-9dabf56214e5-kube-api-access-smkcg\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:25.919887 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.919833    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:17:25.969090 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:25.969070    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-162c600a-kserve-6f57d75489-x6h8t"]
Oct 30 21:17:26.118804 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:26.118777    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61d706a3-c992-43cc-b73c-9dabf56214e5" path="/var/lib/kubelet/pods/61d706a3-c992-43cc-b73c-9dabf56214e5/volumes"
Oct 30 21:17:28.824321 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:28.824291    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:17:43.844169 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:43.844130    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" podUID="a1e7a1c2-4902-4a72-be91-967084841ad8" containerName="main" containerID="cri-o://37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958" gracePeriod=45
Oct 30 21:17:44.102450 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.102395    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:17:44.195157 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195127    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195313 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195197    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195313 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195224    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195313 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195281    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195313 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195301    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195527 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195327    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\" (UniqueName: \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\") pod \"a1e7a1c2-4902-4a72-be91-967084841ad8\" (UID: \"a1e7a1c2-4902-4a72-be91-967084841ad8\") "
Oct 30 21:17:44.195527 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195378    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:44.195527 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195473    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:44.195692 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195583    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:44.195815 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195787    5446 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-home\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.195815 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195811    5446 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-tmp-dir\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.195970 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.195824    5446 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-model-cache\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.197585 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.197568    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:44.198220 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.198199    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:44.198298 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.198239    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls" pod "a1e7a1c2-4902-4a72-be91-967084841ad8" (UID: "a1e7a1c2-4902-4a72-be91-967084841ad8"). InnerVolumeSpecName "kube-api-access-8kfls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:44.297049 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.297025    5446 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e7a1c2-4902-4a72-be91-967084841ad8-tls-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.297049 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.297047    5446 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1e7a1c2-4902-4a72-be91-967084841ad8-dshm\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.297214 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.297058    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kfls\" (UniqueName: \"kubernetes.io/projected/a1e7a1c2-4902-4a72-be91-967084841ad8-kube-api-access-8kfls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:44.609356 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.609327    5446 generic.go:356] "Generic (PLEG): container finished" podID="a1e7a1c2-4902-4a72-be91-967084841ad8" containerID="37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958" exitCode=0
Oct 30 21:17:44.609515 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.609376    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" event={"ID":"a1e7a1c2-4902-4a72-be91-967084841ad8","Type":"ContainerDied","Data":"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"}
Oct 30 21:17:44.609515 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.609391    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"
Oct 30 21:17:44.609515 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.609404    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq" event={"ID":"a1e7a1c2-4902-4a72-be91-967084841ad8","Type":"ContainerDied","Data":"cc6863da7834b48010c747b6c14f96eb85764b131c6f4b49ad1a7c123c47d702"}
Oct 30 21:17:44.609515 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.609422    5446 scope.go:122] "RemoveContainer" containerID="37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"
Oct 30 21:17:44.620271 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.620253    5446 scope.go:122] "RemoveContainer" containerID="37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"
Oct 30 21:17:44.620534 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:17:44.620514    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958\": container with ID starting with 37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958 not found: ID does not exist" containerID="37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"
Oct 30 21:17:44.620575 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.620547    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958"} err="failed to get container status \"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958\": rpc error: code = NotFound desc = could not find container \"37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958\": container with ID starting with 37bc03b9c055eddcadcc50f00ee989b958fc7d1bd84874b22f74e74107640958 not found: ID does not exist"
Oct 30 21:17:44.774377 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.774349    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:17:44.823488 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:44.823465    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-162c600a-kserve-74559d666f-w7qpq"]
Oct 30 21:17:46.119307 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:17:46.119273    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1e7a1c2-4902-4a72-be91-967084841ad8" path="/var/lib/kubelet/pods/a1e7a1c2-4902-4a72-be91-967084841ad8/volumes"
Oct 30 21:17:49.514741 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:17:49.514707    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:18:19.134623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.134594    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"]
Oct 30 21:18:19.135048 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135007    5446 cpu_manager.go:414] "containerMap: removing container" podUID="61d706a3-c992-43cc-b73c-9dabf56214e5" containerName="main"
Oct 30 21:18:19.135048 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135021    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61d706a3-c992-43cc-b73c-9dabf56214e5" containerName="main"
Oct 30 21:18:19.135127 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135072    5446 cpu_manager.go:414] "containerMap: removing container" podUID="a1e7a1c2-4902-4a72-be91-967084841ad8" containerName="main"
Oct 30 21:18:19.135127 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135078    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1e7a1c2-4902-4a72-be91-967084841ad8" containerName="main"
Oct 30 21:18:19.135193 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135135    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1e7a1c2-4902-4a72-be91-967084841ad8" containerName="main"
Oct 30 21:18:19.135193 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.135146    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="61d706a3-c992-43cc-b73c-9dabf56214e5" containerName="main"
Oct 30 21:18:19.139554 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.139531    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.242481 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.242451    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"]
Oct 30 21:18:19.275200 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.275170    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-maas-api-tls\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.275405 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.275233    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-openshift-service-ca\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.275405 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.275325    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-metrics-certs\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.275405 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.275377    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8md\" (UniqueName: \"kubernetes.io/projected/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-kube-api-access-rk8md\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.376769 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.376736    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-openshift-service-ca\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.377002 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.376783    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-metrics-certs\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.377002 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.376824    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8md\" (UniqueName: \"kubernetes.io/projected/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-kube-api-access-rk8md\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.377002 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.376875    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-maas-api-tls\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.377400 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.377373    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-openshift-service-ca\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.379462 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.379442    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-maas-api-tls\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.379538 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.379508    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-metrics-certs\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.435053 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.434990    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8md\" (UniqueName: \"kubernetes.io/projected/7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4-kube-api-access-rk8md\") pod \"maas-api-6d9876d865-jc4cm\" (UID: \"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4\") " pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.451953 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.451932    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:19.525149 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:18:19.525094    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:18:19.827414 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.827343    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"]
Oct 30 21:18:19.830659 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:18:19.830622    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caef3e8_5a7f_4a04_b8d9_b04cd1a11cb4.slice/crio-4a0172ec2376236c2a7bbe0190e9fcbc3b0c5c8d72352ace2c723b26faf0fd08 WatchSource:0}: Error finding container 4a0172ec2376236c2a7bbe0190e9fcbc3b0c5c8d72352ace2c723b26faf0fd08: Status 404 returned error can't find the container with id 4a0172ec2376236c2a7bbe0190e9fcbc3b0c5c8d72352ace2c723b26faf0fd08
Oct 30 21:18:19.831861 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:19.831844    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:18:20.812414 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:20.812386    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm" event={"ID":"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4","Type":"ContainerStarted","Data":"c002e5e05023c90c5fbfe3f3f8b6a828eb14ac312d1629becd561da7e55e4a81"}
Oct 30 21:18:20.812778 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:20.812433    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm" event={"ID":"7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4","Type":"ContainerStarted","Data":"4a0172ec2376236c2a7bbe0190e9fcbc3b0c5c8d72352ace2c723b26faf0fd08"}
Oct 30 21:18:20.812778 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:20.812518    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:20.933017 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:20.932976    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm" podStartSLOduration=1.056089037 podStartE2EDuration="1.932959525s" totalImagesPullingTime="876.870488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:20.931624666 +0000 UTC m=+3066.923627792" watchObservedRunningTime="2026-10-30 21:18:20.932959525 +0000 UTC m=+3066.924962653"
Oct 30 21:18:26.403577 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.403506    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:18:26.407073 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.407057    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.460814 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.460779    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bddeea9c-openshift-default-dockercfg-hqcl4\""
Oct 30 21:18:26.512209 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.512182    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:18:26.540616 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540590    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540765 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540628    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540765 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540665    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540765 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540733    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540879 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540816    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540879 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540847    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7m7\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.540879 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.540867    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.541060 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.541037    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.541112 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.541095    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642497 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642464    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642497 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642501    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642534    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642553    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642577    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642675    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7m7\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.642743 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642710    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642965    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642987    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643145 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.642962    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643145 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.643047    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643252 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.643152    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643359 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.643328    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.643542 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.643428    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.645005 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.644985    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.645383 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.645366    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.700575 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.700521    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.700687 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.700620    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7m7\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\") pod \"e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") " pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.718981 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.718950    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:26.822221 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:26.822197    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d9876d865-jc4cm"
Oct 30 21:18:27.144880 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.144856    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:18:27.147212 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:18:27.147189    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73b531_1fa5_48f2_b047_5b6accc4efd9.slice/crio-3300c34312fa69978e6dfccf18f8dbc606cc1033c072c7b0bf6fe9ded7e06563 WatchSource:0}: Error finding container 3300c34312fa69978e6dfccf18f8dbc606cc1033c072c7b0bf6fe9ded7e06563: Status 404 returned error can't find the container with id 3300c34312fa69978e6dfccf18f8dbc606cc1033c072c7b0bf6fe9ded7e06563
Oct 30 21:18:27.149268 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.149239    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:27.149334 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.149299    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:27.149334 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.149328    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:27.847389 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.847353    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerStarted","Data":"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"}
Oct 30 21:18:27.847761 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.847410    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerStarted","Data":"3300c34312fa69978e6dfccf18f8dbc606cc1033c072c7b0bf6fe9ded7e06563"}
Oct 30 21:18:27.965242 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:27.965195    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podStartSLOduration=1.965181647 podStartE2EDuration="1.965181647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:27.964381612 +0000 UTC m=+3073.956384742" watchObservedRunningTime="2026-10-30 21:18:27.965181647 +0000 UTC m=+3073.957184815"
Oct 30 21:18:28.719728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:28.719700    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:28.724809 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:28.724786    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:28.851991 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:28.851964    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:28.852872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:28.852853    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:35.629426 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:35.629392    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 21:18:35.629803 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:35.629584    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" podUID="ce5d43da-4997-4577-b30a-bc024bb908f3" containerName="maas-api" containerID="cri-o://a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba" gracePeriod=30
Oct 30 21:18:36.878295 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.878269    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 21:18:36.891127 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.891101    5446 generic.go:356] "Generic (PLEG): container finished" podID="ce5d43da-4997-4577-b30a-bc024bb908f3" containerID="a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba" exitCode=0
Oct 30 21:18:36.891221 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.891141    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"
Oct 30 21:18:36.891221 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.891145    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" event={"ID":"ce5d43da-4997-4577-b30a-bc024bb908f3","Type":"ContainerDied","Data":"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"}
Oct 30 21:18:36.891221 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.891186    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8" event={"ID":"ce5d43da-4997-4577-b30a-bc024bb908f3","Type":"ContainerDied","Data":"1e39040913d9d345ed5a021e7ad77d38d4805ac9b905f001444bb83cf90254e5"}
Oct 30 21:18:36.891221 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.891211    5446 scope.go:122] "RemoveContainer" containerID="a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"
Oct 30 21:18:36.899853 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.899834    5446 scope.go:122] "RemoveContainer" containerID="a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"
Oct 30 21:18:36.900130 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:18:36.900113    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba\": container with ID starting with a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba not found: ID does not exist" containerID="a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"
Oct 30 21:18:36.900183 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:36.900149    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba"} err="failed to get container status \"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba\": rpc error: code = NotFound desc = could not find container \"a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba\": container with ID starting with a44bd8e82a9ccf9c723fad1c17d9c345f121fa76709feda0d6b91c9a21cd52ba not found: ID does not exist"
Oct 30 21:18:37.037731 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.037654    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\") pod \"ce5d43da-4997-4577-b30a-bc024bb908f3\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") "
Oct 30 21:18:37.037731 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.037707    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\" (UniqueName: \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\") pod \"ce5d43da-4997-4577-b30a-bc024bb908f3\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") "
Oct 30 21:18:37.037932 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.037767    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\") pod \"ce5d43da-4997-4577-b30a-bc024bb908f3\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") "
Oct 30 21:18:37.037932 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.037819    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\") pod \"ce5d43da-4997-4577-b30a-bc024bb908f3\" (UID: \"ce5d43da-4997-4577-b30a-bc024bb908f3\") "
Oct 30 21:18:37.038190 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.038163    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca" pod "ce5d43da-4997-4577-b30a-bc024bb908f3" (UID: "ce5d43da-4997-4577-b30a-bc024bb908f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:37.040156 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.040123    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs" pod "ce5d43da-4997-4577-b30a-bc024bb908f3" (UID: "ce5d43da-4997-4577-b30a-bc024bb908f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:37.040625 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.040592    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls" pod "ce5d43da-4997-4577-b30a-bc024bb908f3" (UID: "ce5d43da-4997-4577-b30a-bc024bb908f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:37.040625 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.040602    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c" pod "ce5d43da-4997-4577-b30a-bc024bb908f3" (UID: "ce5d43da-4997-4577-b30a-bc024bb908f3"). InnerVolumeSpecName "kube-api-access-nd28c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:37.138692 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.138663    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:37.138692 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.138693    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd28c\" (UniqueName: \"kubernetes.io/projected/ce5d43da-4997-4577-b30a-bc024bb908f3-kube-api-access-nd28c\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:37.138910 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.138710    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d43da-4997-4577-b30a-bc024bb908f3-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:37.138910 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.138723    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce5d43da-4997-4577-b30a-bc024bb908f3-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:37.313728 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.313669    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 21:18:37.318894 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:37.318871    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84b5f84777-r2nm8"]
Oct 30 21:18:38.118819 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:38.118790    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce5d43da-4997-4577-b30a-bc024bb908f3" path="/var/lib/kubelet/pods/ce5d43da-4997-4577-b30a-bc024bb908f3/volumes"
Oct 30 21:18:49.515342 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:18:49.515306    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:18:52.973802 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.973770    5446 generic.go:356] "Generic (PLEG): container finished" podID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerID="42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599" exitCode=0
Oct 30 21:18:52.974228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.973833    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerDied","Data":"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"}
Oct 30 21:18:52.974228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.974154    5446 scope.go:122] "RemoveContainer" containerID="42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"
Oct 30 21:18:52.975253 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.975226    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:52.975322 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.975299    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:52.975360 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:52.975330    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:18:53.980478 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:53.980441    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerStarted","Data":"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"}
Oct 30 21:18:54.719736 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:54.719699    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:54.720636 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:54.720612    5446 patch_prober.go:29] interesting pod/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:18:54.720721 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:54.720661    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused"
Oct 30 21:18:55.720067 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:55.720027    5446 patch_prober.go:29] interesting pod/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:18:55.720467 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:55.720082    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused"
Oct 30 21:18:56.720135 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:56.720103    5446 patch_prober.go:29] interesting pod/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:18:56.720610 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:56.720161    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused"
Oct 30 21:18:57.719595 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:57.719547    5446 patch_prober.go:29] interesting pod/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:18:57.719764 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:57.719616    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused"
Oct 30 21:18:58.720261 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:58.720230    5446 patch_prober.go:29] interesting pod/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:18:58.720648 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:58.720283    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.112:15021/healthz/ready\": dial tcp 10.133.0.112:15021: connect: connection refused"
Oct 30 21:18:58.852465 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:58.852438    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:59.727280 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:59.727250    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:18:59.728474 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:18:59.728445    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:19:19.515569 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:19.515528    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:19:30.401549 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:30.401518    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:19:30.401983 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:30.401719    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy" containerID="cri-o://16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38" gracePeriod=30
Oct 30 21:19:32.632812 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.632785    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:19:32.633262 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.633217    5446 cpu_manager.go:414] "containerMap: removing container" podUID="ce5d43da-4997-4577-b30a-bc024bb908f3" containerName="maas-api"
Oct 30 21:19:32.633262 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.633230    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce5d43da-4997-4577-b30a-bc024bb908f3" containerName="maas-api"
Oct 30 21:19:32.633345 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.633325    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce5d43da-4997-4577-b30a-bc024bb908f3" containerName="maas-api"
Oct 30 21:19:32.637642 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.637625    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.740127 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.740094    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:19:32.772200 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772167    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772363 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772220    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772363 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772344    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772403    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772490 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772478    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772587 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772506    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772587 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772527    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772665 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772625    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.772665 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.772657    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66s4b\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.787252 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.787227    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-authcfg-http-545519-openshift-default-dockercfg-xsxr4\""
Oct 30 21:19:32.873580 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873544    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.873580 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873583    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.873805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873640    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.873805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873671    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66s4b\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.873805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873743    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.873805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873792    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874047 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873819    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874047 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873875    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874047 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.873954    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874201 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.874174    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874271 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.874233    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874390 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.874362    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874455 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.874441    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.874538 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.874515    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.876291 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.876270    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.876388 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.876347    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.931585 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.931535    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.931771 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.931751    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66s4b\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\") pod \"e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") " pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:32.950460 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:32.950441    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:33.375165 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:33.375129    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:19:33.378351 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:19:33.378327    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457e8405_c940_479a_9079_2e8e794fc102.slice/crio-e6e0f060fee566d776a4eb49b1718daf8b987874956291cab5cc66a6f33e7928 WatchSource:0}: Error finding container e6e0f060fee566d776a4eb49b1718daf8b987874956291cab5cc66a6f33e7928: Status 404 returned error can't find the container with id e6e0f060fee566d776a4eb49b1718daf8b987874956291cab5cc66a6f33e7928
Oct 30 21:19:33.380314 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:33.380284    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:19:33.380406 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:33.380342    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:19:33.380406 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:33.380369    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:19:34.193265 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:34.193202    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerStarted","Data":"32faf299f02da0f1b7446363da6f4d1aae8410a7036cfd72049bd95fecb17717"}
Oct 30 21:19:34.193265 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:34.193260    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerStarted","Data":"e6e0f060fee566d776a4eb49b1718daf8b987874956291cab5cc66a6f33e7928"}
Oct 30 21:19:34.360504 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:34.360455    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podStartSLOduration=2.360441372 podStartE2EDuration="2.360441372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:34.359379865 +0000 UTC m=+3140.351382994" watchObservedRunningTime="2026-10-30 21:19:34.360441372 +0000 UTC m=+3140.352444498"
Oct 30 21:19:34.951304 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:34.951271    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:34.956065 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:34.956040    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:35.197796 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.197767    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:35.198571 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.198555    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:19:35.658134 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.658112    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:19:35.701271 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701214    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701271 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701259    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701289    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701374    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701405    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701422    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701437 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701439    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701714 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701479    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701714 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701522    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\") pod \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\" (UID: \"4a73b531-1fa5-48f2-b047-5b6accc4efd9\") "
Oct 30 21:19:35.701872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701474    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:35.701872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701744    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:35.701872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701496    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:35.701872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701757    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:35.701872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701762    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:35.702131 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701957    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.702131 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701979    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.702131 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.701994    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.702131 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.702008    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.702131 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.702022    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.703754 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.703732    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:19:35.703754 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.703739    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "kube-api-access-7q7m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:35.704139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.704119    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:35.704139 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.704125    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token" pod "4a73b531-1fa5-48f2-b047-5b6accc4efd9" (UID: "4a73b531-1fa5-48f2-b047-5b6accc4efd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:35.802615 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.802593    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.802615 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.802615    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.802736 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.802625    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a73b531-1fa5-48f2-b047-5b6accc4efd9-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:35.802736 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:35.802635    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q7m7\" (UniqueName: \"kubernetes.io/projected/4a73b531-1fa5-48f2-b047-5b6accc4efd9-kube-api-access-7q7m7\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:36.204128 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.204098    5446 generic.go:356] "Generic (PLEG): container finished" podID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerID="16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38" exitCode=0
Oct 30 21:19:36.204495 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.204146    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"
Oct 30 21:19:36.204495 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.204177    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerDied","Data":"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"}
Oct 30 21:19:36.204495 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.204226    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc" event={"ID":"4a73b531-1fa5-48f2-b047-5b6accc4efd9","Type":"ContainerDied","Data":"3300c34312fa69978e6dfccf18f8dbc606cc1033c072c7b0bf6fe9ded7e06563"}
Oct 30 21:19:36.204495 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.204246    5446 scope.go:122] "RemoveContainer" containerID="16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"
Oct 30 21:19:36.213075 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.213057    5446 scope.go:122] "RemoveContainer" containerID="42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"
Oct 30 21:19:36.221085 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.221068    5446 scope.go:122] "RemoveContainer" containerID="16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"
Oct 30 21:19:36.221373 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:36.221347    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38\": container with ID starting with 16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38 not found: ID does not exist" containerID="16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"
Oct 30 21:19:36.221446 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.221382    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38"} err="failed to get container status \"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38\": rpc error: code = NotFound desc = could not find container \"16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38\": container with ID starting with 16060740d0607941ecbff99bc6dcff024d04588380c8e51b9ea585d856124d38 not found: ID does not exist"
Oct 30 21:19:36.221446 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.221399    5446 scope.go:122] "RemoveContainer" containerID="42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"
Oct 30 21:19:36.221652 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:36.221637    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599\": container with ID starting with 42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599 not found: ID does not exist" containerID="42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"
Oct 30 21:19:36.221701 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.221657    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599"} err="failed to get container status \"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599\": rpc error: code = NotFound desc = could not find container \"42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599\": container with ID starting with 42517af94d8fcf6f160c9ccdfbac0ce13023cac6276daa611bbc51e8d64aa599 not found: ID does not exist"
Oct 30 21:19:36.370383 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.370349    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:19:36.419605 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:36.419547    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bddeea9c-openshift-default-75bfb7747-v5rcc"]
Oct 30 21:19:38.119053 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:38.119012    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" path="/var/lib/kubelet/pods/4a73b531-1fa5-48f2-b047-5b6accc4efd9/volumes"
Oct 30 21:19:41.238805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.238776    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:19:41.239296 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239209    5446 cpu_manager.go:414] "containerMap: removing container" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.239296 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239221    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.239296 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239233    5446 cpu_manager.go:414] "containerMap: removing container" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.239296 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239239    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.239429 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239303    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.239429 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.239310    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a73b531-1fa5-48f2-b047-5b6accc4efd9" containerName="istio-proxy"
Oct 30 21:19:41.243594 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.243571    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.300605 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.300577    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:19:41.347835 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.347807    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-authcfg-http-545519-dockercfg-89bqw\""
Oct 30 21:19:41.347974 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.347862    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-authcfg-http-545519\""
Oct 30 21:19:41.351376 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.351356    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz8gd\" (UniqueName: \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.351511 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.351491    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.452722 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.452697    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.452844 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.452750    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz8gd\" (UniqueName: \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.453420 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.453400    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.510709 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.510648    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz8gd\" (UniqueName: \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\") pod \"payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.555864 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.555843    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:41.928931 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:41.928894    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:19:41.931423 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:19:41.931394    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db32bc2_d33a_4234_8ea3_880b878225d3.slice/crio-b275f694c187b7ca55552c6a227d506989039dbc09e9e86d4bab608998a25386 WatchSource:0}: Error finding container b275f694c187b7ca55552c6a227d506989039dbc09e9e86d4bab608998a25386: Status 404 returned error can't find the container with id b275f694c187b7ca55552c6a227d506989039dbc09e9e86d4bab608998a25386
Oct 30 21:19:42.237448 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:42.237368    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" event={"ID":"6db32bc2-d33a-4234-8ea3-880b878225d3","Type":"ContainerStarted","Data":"c2a72f73cd5dc723b3e9397a8783bb725fa7e811a65714c85b12c53d8fd14e81"}
Oct 30 21:19:42.237448 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:42.237416    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" event={"ID":"6db32bc2-d33a-4234-8ea3-880b878225d3","Type":"ContainerStarted","Data":"b275f694c187b7ca55552c6a227d506989039dbc09e9e86d4bab608998a25386"}
Oct 30 21:19:42.237641 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:42.237465    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:19:42.354327 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:42.354283    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" podStartSLOduration=1.3542695120000001 podStartE2EDuration="1.354269512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:42.353220578 +0000 UTC m=+3148.345223707" watchObservedRunningTime="2026-10-30 21:19:42.354269512 +0000 UTC m=+3148.346272672"
Oct 30 21:19:43.516429 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.516384    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:19:43.520175 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.520159    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.573358 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.573335    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx64x\" (UniqueName: \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.573477 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.573365    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.573477 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.573395    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.573556 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.573498    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.623805 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.623773    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-545519-serving-cert\""
Oct 30 21:19:43.625483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.625464    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:19:43.674533 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.674508    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.674668 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.674601    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx64x\" (UniqueName: \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.674668 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.674620    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.674668 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.674659    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.674844 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:43.674758    5446 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-serving-cert: secret "maas-api-e2e-authcfg-http-545519-serving-cert" not found
Oct 30 21:19:43.674844 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:43.674827    5446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls podName:1ac5437e-3bfa-45c2-8c20-513883f0304c nodeName:}" failed. No retries permitted until 2026-10-30 21:19:44.174807096 +0000 UTC m=+3150.166810215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls") pod "maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" (UID: "1ac5437e-3bfa-45c2-8c20-513883f0304c") : secret "maas-api-e2e-authcfg-http-545519-serving-cert" not found
Oct 30 21:19:43.675332 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.675304    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.677164 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.677129    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:43.733231 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:43.733205    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx64x\" (UniqueName: \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:44.180460 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:44.180421    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:44.183119 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:44.183092    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:44.432610 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:44.432538    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:44.805488 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:44.805457    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:19:44.808323 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:19:44.808286    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac5437e_3bfa_45c2_8c20_513883f0304c.slice/crio-f1227607139be8c66fccd7c500a421e9cb591834fc85e128232c59059ea9ac22 WatchSource:0}: Error finding container f1227607139be8c66fccd7c500a421e9cb591834fc85e128232c59059ea9ac22: Status 404 returned error can't find the container with id f1227607139be8c66fccd7c500a421e9cb591834fc85e128232c59059ea9ac22
Oct 30 21:19:45.253001 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:45.252971    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" event={"ID":"1ac5437e-3bfa-45c2-8c20-513883f0304c","Type":"ContainerStarted","Data":"f1227607139be8c66fccd7c500a421e9cb591834fc85e128232c59059ea9ac22"}
Oct 30 21:19:46.260198 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:46.260149    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" event={"ID":"1ac5437e-3bfa-45c2-8c20-513883f0304c","Type":"ContainerStarted","Data":"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"}
Oct 30 21:19:46.260689 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:46.260290    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:46.375950 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:46.375877    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" podStartSLOduration=2.514829754 podStartE2EDuration="3.375860258s" totalImagesPullingTime="861.030504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:46.37489847 +0000 UTC m=+3152.366901597" watchObservedRunningTime="2026-10-30 21:19:46.375860258 +0000 UTC m=+3152.367863387"
Oct 30 21:19:49.515254 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:19:49.515216    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:19:52.271047 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:52.270973    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:19:53.247282 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:19:53.247251    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:20:01.353454 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.353353    5446 generic.go:356] "Generic (PLEG): container finished" podID="457e8405-c940-479a-9079-2e8e794fc102" containerID="32faf299f02da0f1b7446363da6f4d1aae8410a7036cfd72049bd95fecb17717" exitCode=0
Oct 30 21:20:01.353454 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.353436    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerDied","Data":"32faf299f02da0f1b7446363da6f4d1aae8410a7036cfd72049bd95fecb17717"}
Oct 30 21:20:01.353946 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.353839    5446 scope.go:122] "RemoveContainer" containerID="32faf299f02da0f1b7446363da6f4d1aae8410a7036cfd72049bd95fecb17717"
Oct 30 21:20:01.355111 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.355081    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:20:01.355228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.355166    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:20:01.355228 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:01.355213    5446 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:20:02.360113 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:02.360076    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerStarted","Data":"0b6167d1cf2595e6cea2c822cc393821ae8ce4d1a9842f4f189c6176a6fa8f8e"}
Oct 30 21:20:02.951163 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:02.951127    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:20:02.952320 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:02.952299    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused" start-of-body=
Oct 30 21:20:02.952397 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:02.952347    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused"
Oct 30 21:20:03.950832 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:03.950799    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused" start-of-body=
Oct 30 21:20:03.951339 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:03.950855    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused"
Oct 30 21:20:04.951645 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:04.951607    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused" start-of-body=
Oct 30 21:20:04.952066 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:04.951676    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused"
Oct 30 21:20:05.209107 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:05.209004    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:20:05.951558 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:05.951528    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused" start-of-body=
Oct 30 21:20:05.951734 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:05.951581    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused"
Oct 30 21:20:06.951801 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:06.951764    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused" start-of-body=
Oct 30 21:20:06.952209 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:06.951853    5446 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.113:15021/healthz/ready\": dial tcp 10.133.0.113:15021: connect: connection refused"
Oct 30 21:20:07.956093 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:07.956058    5446 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:20:07.956979 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:20:07.956962    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:20:19.514669 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:20:19.514633    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:20:49.514339 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:20:49.514303    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:21:19.514959 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:21:19.514894    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:21:33.628572 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:33.628536    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:21:38.629855 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.629797    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" podUID="6db32bc2-d33a-4234-8ea3-880b878225d3" containerName="payload-processing" containerID="cri-o://c2a72f73cd5dc723b3e9397a8783bb725fa7e811a65714c85b12c53d8fd14e81" gracePeriod=25
Oct 30 21:21:38.821523 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.821493    5446 generic.go:356] "Generic (PLEG): container finished" podID="6db32bc2-d33a-4234-8ea3-880b878225d3" containerID="c2a72f73cd5dc723b3e9397a8783bb725fa7e811a65714c85b12c53d8fd14e81" exitCode=0
Oct 30 21:21:38.821643 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.821611    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" event={"ID":"6db32bc2-d33a-4234-8ea3-880b878225d3","Type":"ContainerDied","Data":"c2a72f73cd5dc723b3e9397a8783bb725fa7e811a65714c85b12c53d8fd14e81"}
Oct 30 21:21:38.879461 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.879439    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:21:38.954816 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.954758    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\") pod \"6db32bc2-d33a-4234-8ea3-880b878225d3\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") "
Oct 30 21:21:38.954816 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.954802    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\" (UniqueName: \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\") pod \"6db32bc2-d33a-4234-8ea3-880b878225d3\" (UID: \"6db32bc2-d33a-4234-8ea3-880b878225d3\") "
Oct 30 21:21:38.955203 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.955177    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume" pod "6db32bc2-d33a-4234-8ea3-880b878225d3" (UID: "6db32bc2-d33a-4234-8ea3-880b878225d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:38.957032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:38.957004    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd" pod "6db32bc2-d33a-4234-8ea3-880b878225d3" (UID: "6db32bc2-d33a-4234-8ea3-880b878225d3"). InnerVolumeSpecName "kube-api-access-tz8gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:39.055623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.055597    5446 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6db32bc2-d33a-4234-8ea3-880b878225d3-plugins-config-volume\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.055623 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.055623    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz8gd\" (UniqueName: \"kubernetes.io/projected/6db32bc2-d33a-4234-8ea3-880b878225d3-kube-api-access-tz8gd\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.828235 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.828207    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"
Oct 30 21:21:39.828657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.828234    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8" event={"ID":"6db32bc2-d33a-4234-8ea3-880b878225d3","Type":"ContainerDied","Data":"b275f694c187b7ca55552c6a227d506989039dbc09e9e86d4bab608998a25386"}
Oct 30 21:21:39.828657 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.828284    5446 scope.go:122] "RemoveContainer" containerID="c2a72f73cd5dc723b3e9397a8783bb725fa7e811a65714c85b12c53d8fd14e81"
Oct 30 21:21:39.993746 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:39.993722    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:21:40.042882 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:40.042860    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-545519-798dcdb6-m7bw8"]
Oct 30 21:21:40.118616 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:40.118587    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6db32bc2-d33a-4234-8ea3-880b878225d3" path="/var/lib/kubelet/pods/6db32bc2-d33a-4234-8ea3-880b878225d3/volumes"
Oct 30 21:21:43.166239 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.166206    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:21:43.166675 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.166451    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" podUID="1ac5437e-3bfa-45c2-8c20-513883f0304c" containerName="maas-api" containerID="cri-o://48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12" gracePeriod=30
Oct 30 21:21:43.430113 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.430055    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:21:43.593225 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593180    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\") pod \"1ac5437e-3bfa-45c2-8c20-513883f0304c\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") "
Oct 30 21:21:43.593407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593235    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\") pod \"1ac5437e-3bfa-45c2-8c20-513883f0304c\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") "
Oct 30 21:21:43.593407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593311    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\" (UniqueName: \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\") pod \"1ac5437e-3bfa-45c2-8c20-513883f0304c\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") "
Oct 30 21:21:43.593407 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593339    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") pod \"1ac5437e-3bfa-45c2-8c20-513883f0304c\" (UID: \"1ac5437e-3bfa-45c2-8c20-513883f0304c\") "
Oct 30 21:21:43.593632 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593606    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca" pod "1ac5437e-3bfa-45c2-8c20-513883f0304c" (UID: "1ac5437e-3bfa-45c2-8c20-513883f0304c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:43.593760 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.593743    5446 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac5437e-3bfa-45c2-8c20-513883f0304c-openshift-service-ca\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:43.595638 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.595609    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls" pod "1ac5437e-3bfa-45c2-8c20-513883f0304c" (UID: "1ac5437e-3bfa-45c2-8c20-513883f0304c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:43.595748 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.595646    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs" pod "1ac5437e-3bfa-45c2-8c20-513883f0304c" (UID: "1ac5437e-3bfa-45c2-8c20-513883f0304c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:43.595748 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.595658    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x" pod "1ac5437e-3bfa-45c2-8c20-513883f0304c" (UID: "1ac5437e-3bfa-45c2-8c20-513883f0304c"). InnerVolumeSpecName "kube-api-access-mx64x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:43.695182 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.695107    5446 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-metrics-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:43.695182 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.695137    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx64x\" (UniqueName: \"kubernetes.io/projected/1ac5437e-3bfa-45c2-8c20-513883f0304c-kube-api-access-mx64x\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:43.695182 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.695148    5446 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ac5437e-3bfa-45c2-8c20-513883f0304c-maas-api-tls\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:43.849314 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.849279    5446 generic.go:356] "Generic (PLEG): container finished" podID="1ac5437e-3bfa-45c2-8c20-513883f0304c" containerID="48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12" exitCode=0
Oct 30 21:21:43.849502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.849324    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"
Oct 30 21:21:43.849502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.849360    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" event={"ID":"1ac5437e-3bfa-45c2-8c20-513883f0304c","Type":"ContainerDied","Data":"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"}
Oct 30 21:21:43.849502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.849423    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs" event={"ID":"1ac5437e-3bfa-45c2-8c20-513883f0304c","Type":"ContainerDied","Data":"f1227607139be8c66fccd7c500a421e9cb591834fc85e128232c59059ea9ac22"}
Oct 30 21:21:43.849502 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.849455    5446 scope.go:122] "RemoveContainer" containerID="48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"
Oct 30 21:21:43.859555 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.859541    5446 scope.go:122] "RemoveContainer" containerID="48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"
Oct 30 21:21:43.859793 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:21:43.859774    5446 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12\": container with ID starting with 48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12 not found: ID does not exist" containerID="48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"
Oct 30 21:21:43.859857 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:43.859806    5446 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12"} err="failed to get container status \"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12\": rpc error: code = NotFound desc = could not find container \"48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12\": container with ID starting with 48b56168eb63aee96d3ad6a77d3cfeb24b832a68976169ce0ef170ad4a8e6d12 not found: ID does not exist"
Oct 30 21:21:44.016809 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:44.016752    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:21:44.019111 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:44.019091    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-545519-77444dcb89-n9wfs"]
Oct 30 21:21:44.123089 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:44.123051    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ac5437e-3bfa-45c2-8c20-513883f0304c" path="/var/lib/kubelet/pods/1ac5437e-3bfa-45c2-8c20-513883f0304c/volumes"
Oct 30 21:21:49.517097 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:21:49.517063    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:21:52.744694 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:52.744664    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:21:52.745212 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:52.744895    5446 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" containerID="cri-o://0b6167d1cf2595e6cea2c822cc393821ae8ce4d1a9842f4f189c6176a6fa8f8e" gracePeriod=30
Oct 30 21:21:52.958032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:52.957995    5446 patch_prober.go:29] interesting pod/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:21:52.958187 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:52.958064    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:21:57.965483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:57.965134    5446 generic.go:356] "Generic (PLEG): container finished" podID="457e8405-c940-479a-9079-2e8e794fc102" containerID="0b6167d1cf2595e6cea2c822cc393821ae8ce4d1a9842f4f189c6176a6fa8f8e" exitCode=0
Oct 30 21:21:57.965483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:57.965297    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerDied","Data":"0b6167d1cf2595e6cea2c822cc393821ae8ce4d1a9842f4f189c6176a6fa8f8e"}
Oct 30 21:21:57.965483 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:57.965357    5446 scope.go:122] "RemoveContainer" containerID="32faf299f02da0f1b7446363da6f4d1aae8410a7036cfd72049bd95fecb17717"
Oct 30 21:21:58.306945 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.304065    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:21:58.372807 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.372778    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.372968 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.372818    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.372968 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.372851    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.372964    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373002    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373029    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373062    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373103    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373197    5446 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\") pod \"457e8405-c940-479a-9079-2e8e794fc102\" (UID: \"457e8405-c940-479a-9079-2e8e794fc102\") "
Oct 30 21:21:58.373293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373233    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:58.373445 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373322    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:58.373445 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373343    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:58.373445 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373386    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:58.373613 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373525    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:58.373613 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373591    5446 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457e8405-c940-479a-9079-2e8e794fc102-istiod-ca-cert\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.373747 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373613    5446 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-credential-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.373747 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373628    5446 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-socket\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.373747 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.373642    5446 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-workload-certs\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.375417 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.375388    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:58.375569 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.375549    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:58.375864 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.375829    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:21:58.375953 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.375833    5446 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b" pod "457e8405-c940-479a-9079-2e8e794fc102" (UID: "457e8405-c940-479a-9079-2e8e794fc102"). InnerVolumeSpecName "kube-api-access-66s4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:58.474862 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.474740    5446 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-data\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.474862 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.474786    5446 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-istio-token\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.474862 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.474803    5446 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457e8405-c940-479a-9079-2e8e794fc102-istio-envoy\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.474862 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.474818    5446 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66s4b\" (UniqueName: \"kubernetes.io/projected/457e8405-c940-479a-9079-2e8e794fc102-kube-api-access-66s4b\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.474862 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.474835    5446 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457e8405-c940-479a-9079-2e8e794fc102-istio-podinfo\") on node \"ip-10-0-135-188.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:58.973587 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.973551    5446 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"
Oct 30 21:21:58.973587 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.973570    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66" event={"ID":"457e8405-c940-479a-9079-2e8e794fc102","Type":"ContainerDied","Data":"e6e0f060fee566d776a4eb49b1718daf8b987874956291cab5cc66a6f33e7928"}
Oct 30 21:21:58.974078 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:58.973683    5446 scope.go:122] "RemoveContainer" containerID="0b6167d1cf2595e6cea2c822cc393821ae8ce4d1a9842f4f189c6176a6fa8f8e"
Oct 30 21:21:59.140057 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:59.140021    5446 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:21:59.189032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:21:59.189002    5446 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-authcfg-http-545519-openshift-default-7664c8f777-kcl66"]
Oct 30 21:22:00.118854 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:22:00.118823    5446 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="457e8405-c940-479a-9079-2e8e794fc102" path="/var/lib/kubelet/pods/457e8405-c940-479a-9079-2e8e794fc102/volumes"
Oct 30 21:22:17.819038 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:22:17.818999    5446 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58847f9fc5-tcxrk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:22:17.819712 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:22:17.819677    5446 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-tcxrk" podUID="accdad77-bc95-4deb-8e45-2aecf980b1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:22:19.515639 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:22:19.515601    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:22:49.514367 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:22:49.514328    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:23:08.214835 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:08.214806    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5849dbdbbb-l5k9d_b694b600-45a9-457c-9e5c-2816c8563225/authorino/0.log"
Oct 30 21:23:19.402382 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:19.402348    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5574f9c87-txzj9_73088761-92a4-4823-9436-d0e91e9add3b/manager/0.log"
Oct 30 21:23:19.515420 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:23:19.515388    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:23:23.038035 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:23.038007    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d9876d865-jc4cm_7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4/maas-api/0.log"
Oct 30 21:23:25.540537 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:25.540510    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5849dbdbbb-l5k9d_b694b600-45a9-457c-9e5c-2816c8563225/authorino/0.log"
Oct 30 21:23:29.089811 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:29.089783    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65fc6db558-p7csx_52d639cc-b837-4d5b-b36c-438382d9db6a/kube-auth-proxy/0.log"
Oct 30 21:23:29.611561 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:29.611521    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-4pc86_c8f1acdf-95cd-41f7-9924-d96419b99562/istio-proxy/0.log"
Oct 30 21:23:31.168298 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:31.168261    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-tcxrk_accdad77-bc95-4deb-8e45-2aecf980b1f6/istio-proxy/0.log"
Oct 30 21:23:31.389980 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:31.389953    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-wlz59_931ffb02-16c9-49ca-8aad-55a682e64209/istio-proxy/0.log"
Oct 30 21:23:32.056395 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:32.056368    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-5776v_4fbaa887-b5fb-468a-90ba-950f14b3eea9/payload-pre-processing/0.log"
Oct 30 21:23:32.274265 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:32.274241    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:23:33.335778 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:33.335755    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p_9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa/main/0.log"
Oct 30 21:23:33.569400 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:33.569374    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-vpvxp_11f58c83-143c-409c-acda-d1355f4d6f1e/main/0.log"
Oct 30 21:23:33.800340 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:33.800313    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-s2fhj_86511d0a-2335-49fa-875f-3c2e88d49bc7/main/0.log"
Oct 30 21:23:34.032211 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:34.032181    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-gz8hl_6a64b45d-291b-448f-a9e6-4d502a67b547/main/0.log"
Oct 30 21:23:34.487018 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:34.486986    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-mn78n_eff48eb3-c498-4663-a094-7f4fed6b8027/main/0.log"
Oct 30 21:23:34.715068 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:34.715038    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn_0868fc8e-eb11-4328-b235-6f76f8a82460/main/0.log"
Oct 30 21:23:34.944663 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:34.944638    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5_47fb9715-f515-4d27-9657-00908b6e3de3/main/0.log"
Oct 30 21:23:35.956787 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:35.956741    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5849dbdbbb-l5k9d_b694b600-45a9-457c-9e5c-2816c8563225/authorino/0.log"
Oct 30 21:23:45.583105 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:45.583074    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5574f9c87-txzj9_73088761-92a4-4823-9436-d0e91e9add3b/manager/0.log"
Oct 30 21:23:49.045725 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:49.045694    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d9876d865-jc4cm_7caef3e8-5a7f-4a04-b8d9-b04cd1a11cb4/maas-api/0.log"
Oct 30 21:23:49.515705 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:23:49.515669    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:23:51.329241 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:51.329212    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5849dbdbbb-l5k9d_b694b600-45a9-457c-9e5c-2816c8563225/authorino/0.log"
Oct 30 21:23:55.417036 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:55.417003    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65fc6db558-p7csx_52d639cc-b837-4d5b-b36c-438382d9db6a/kube-auth-proxy/0.log"
Oct 30 21:23:56.085491 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:56.085463    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-4pc86_c8f1acdf-95cd-41f7-9924-d96419b99562/istio-proxy/0.log"
Oct 30 21:23:57.967630 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:57.967598    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-tcxrk_accdad77-bc95-4deb-8e45-2aecf980b1f6/istio-proxy/0.log"
Oct 30 21:23:58.210946 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:58.210905    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58847f9fc5-wlz59_931ffb02-16c9-49ca-8aad-55a682e64209/istio-proxy/0.log"
Oct 30 21:23:58.939774 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:58.939742    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-5776v_4fbaa887-b5fb-468a-90ba-950f14b3eea9/payload-pre-processing/0.log"
Oct 30 21:23:59.174125 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:59.174062    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:23:59.997810 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:23:59.997780    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-mzl2p_9d2ab5d7-d4cd-41f3-a1e3-9b68bb207dfa/main/0.log"
Oct 30 21:24:00.240293 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:00.240255    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-vpvxp_11f58c83-143c-409c-acda-d1355f4d6f1e/main/0.log"
Oct 30 21:24:00.482373 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:00.482342    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-s2fhj_86511d0a-2335-49fa-875f-3c2e88d49bc7/main/0.log"
Oct 30 21:24:00.711593 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:00.711567    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-gz8hl_6a64b45d-291b-448f-a9e6-4d502a67b547/main/0.log"
Oct 30 21:24:01.190662 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:01.190635    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-mn78n_eff48eb3-c498-4663-a094-7f4fed6b8027/main/0.log"
Oct 30 21:24:01.432757 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:01.432731    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-q75kn_0868fc8e-eb11-4328-b235-6f76f8a82460/main/0.log"
Oct 30 21:24:01.670871 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:01.670846    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-f9ng5_47fb9715-f515-4d27-9657-00908b6e3de3/main/0.log"
Oct 30 21:24:19.514724 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:24:19.514687    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:24:32.953757 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:32.953689    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:24:33.179609 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:24:33.179585    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:24:49.515081 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:24:49.515045    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:25:14.121668 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.121635    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:25:14.347147 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.347119    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-fq798_e8ddc402-f3e6-49b6-bc35-e1de7c2ca4aa/payload-processing/0.log"
Oct 30 21:25:14.698999 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.698035    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4r57/must-gather-k4gp8"]
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699685    5446 cpu_manager.go:414] "containerMap: removing container" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699711    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699763    5446 cpu_manager.go:414] "containerMap: removing container" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699771    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699812    5446 cpu_manager.go:414] "containerMap: removing container" podUID="1ac5437e-3bfa-45c2-8c20-513883f0304c" containerName="maas-api"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699819    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ac5437e-3bfa-45c2-8c20-513883f0304c" containerName="maas-api"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699854    5446 cpu_manager.go:414] "containerMap: removing container" podUID="6db32bc2-d33a-4234-8ea3-880b878225d3" containerName="payload-processing"
Oct 30 21:25:14.699952 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.699861    5446 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6db32bc2-d33a-4234-8ea3-880b878225d3" containerName="payload-processing"
Oct 30 21:25:14.702226 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.700556    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ac5437e-3bfa-45c2-8c20-513883f0304c" containerName="maas-api"
Oct 30 21:25:14.702226 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.700581    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="6db32bc2-d33a-4234-8ea3-880b878225d3" containerName="payload-processing"
Oct 30 21:25:14.702226 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.700600    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.702226 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.700613    5446 memory_manager.go:365] "RemoveStaleState removing state" podUID="457e8405-c940-479a-9079-2e8e794fc102" containerName="istio-proxy"
Oct 30 21:25:14.705250 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.705215    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:14.807086 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.807051    5446 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4r57\"/\"default-dockercfg-sq655\""
Oct 30 21:25:14.807198 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.807105    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4r57\"/\"openshift-service-ca.crt\""
Oct 30 21:25:14.807198 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.807135    5446 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4r57\"/\"kube-root-ca.crt\""
Oct 30 21:25:14.808615 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.808597    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4r57/must-gather-k4gp8"]
Oct 30 21:25:14.845295 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.845274    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zrgt\" (UniqueName: \"kubernetes.io/projected/8112b606-d224-495d-9472-63e03777450d-kube-api-access-6zrgt\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:14.845383 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.845311    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8112b606-d224-495d-9472-63e03777450d-must-gather-output\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:14.946147 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.946125    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrgt\" (UniqueName: \"kubernetes.io/projected/8112b606-d224-495d-9472-63e03777450d-kube-api-access-6zrgt\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:14.946236 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.946162    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8112b606-d224-495d-9472-63e03777450d-must-gather-output\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:14.946505 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:14.946490    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8112b606-d224-495d-9472-63e03777450d-must-gather-output\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:15.004129 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:15.004076    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zrgt\" (UniqueName: \"kubernetes.io/projected/8112b606-d224-495d-9472-63e03777450d-kube-api-access-6zrgt\") pod \"must-gather-k4gp8\" (UID: \"8112b606-d224-495d-9472-63e03777450d\") " pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:15.019372 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:15.019350    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4r57/must-gather-k4gp8"
Oct 30 21:25:15.394387 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:15.394315    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4r57/must-gather-k4gp8"]
Oct 30 21:25:15.397114 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:25:15.397090    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8112b606_d224_495d_9472_63e03777450d.slice/crio-65f68570ab17a99c9323e4474d40f44abe82e18d90a43eb497f2ac4cbcc3b612 WatchSource:0}: Error finding container 65f68570ab17a99c9323e4474d40f44abe82e18d90a43eb497f2ac4cbcc3b612: Status 404 returned error can't find the container with id 65f68570ab17a99c9323e4474d40f44abe82e18d90a43eb497f2ac4cbcc3b612
Oct 30 21:25:15.399218 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:15.399197    5446 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:25:15.929985 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:15.929944    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4r57/must-gather-k4gp8" event={"ID":"8112b606-d224-495d-9472-63e03777450d","Type":"ContainerStarted","Data":"65f68570ab17a99c9323e4474d40f44abe82e18d90a43eb497f2ac4cbcc3b612"}
Oct 30 21:25:16.938002 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:16.937904    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4r57/must-gather-k4gp8" event={"ID":"8112b606-d224-495d-9472-63e03777450d","Type":"ContainerStarted","Data":"e286f64fe8cb1a72e3a4c6af8c0d81281a04cb69e4851146910dfebfa0116de7"}
Oct 30 21:25:16.938002 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:16.937977    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4r57/must-gather-k4gp8" event={"ID":"8112b606-d224-495d-9472-63e03777450d","Type":"ContainerStarted","Data":"6c405e344c48e96c37622d950b5c74bb989fef822fe60f927e33af35bad9284f"}
Oct 30 21:25:17.053044 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:17.052981    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-x4r57/must-gather-k4gp8" podStartSLOduration=1.773862807 podStartE2EDuration="3.052962937s" totalImagesPullingTime="1.27910013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:17.052412132 +0000 UTC m=+3483.044415258" watchObservedRunningTime="2026-10-30 21:25:17.052962937 +0000 UTC m=+3483.044966064"
Oct 30 21:25:19.515678 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:25:19.515644    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:25:25.178868 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:25.178732    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tn2wd_c6215d32-ffbd-4fbf-a13d-3df9527fcd53/global-pull-secret-syncer/0.log"
Oct 30 21:25:27.980341 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:27.980301    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mkf8g_03a2d959-f0ce-422a-8132-74000b5383a0/konnectivity-agent/0.log"
Oct 30 21:25:28.377905 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:28.377871    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-188.us-west-1.compute.internal_ee272d910da8698a9f404977ca9d2f88/haproxy/0.log"
Oct 30 21:25:33.218304 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.218257    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5849dbdbbb-l5k9d_b694b600-45a9-457c-9e5c-2816c8563225/authorino/0.log"
Oct 30 21:25:33.434898 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.434857    5446 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"]
Oct 30 21:25:33.439997 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.439975    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.496032 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.495954    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"]
Oct 30 21:25:33.531373 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.531341    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66w7g\" (UniqueName: \"kubernetes.io/projected/a63fa02a-0d4a-4709-9572-18b57a14a44d-kube-api-access-66w7g\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.531537 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.531407    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-proc\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.531583 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.531523    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-lib-modules\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.531583 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.531577    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-podres\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.531787 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.531760    5446 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-sys\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.632983 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.632950    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66w7g\" (UniqueName: \"kubernetes.io/projected/a63fa02a-0d4a-4709-9572-18b57a14a44d-kube-api-access-66w7g\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633189 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633032    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-proc\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633189 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633073    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-lib-modules\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633189 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633118    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-podres\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633195    5446 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-sys\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633204    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-proc\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633259    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-podres\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633219    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-lib-modules\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.633353 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.633307    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63fa02a-0d4a-4709-9572-18b57a14a44d-sys\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.690847 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.690812    5446 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66w7g\" (UniqueName: \"kubernetes.io/projected/a63fa02a-0d4a-4709-9572-18b57a14a44d-kube-api-access-66w7g\") pod \"perf-node-gather-daemonset-sgtpx\" (UID: \"a63fa02a-0d4a-4709-9572-18b57a14a44d\") " pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:33.752723 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:33.752638    5446 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:34.146616 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:34.146587    5446 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"]
Oct 30 21:25:34.150006 ip-10-0-135-188 kubenswrapper[5446]: W1030 21:25:34.149974    5446 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda63fa02a_0d4a_4709_9572_18b57a14a44d.slice/crio-a472f623c9e96dff5d10e226210e57cfb22282a7df9840f90923608874a67b3c WatchSource:0}: Error finding container a472f623c9e96dff5d10e226210e57cfb22282a7df9840f90923608874a67b3c: Status 404 returned error can't find the container with id a472f623c9e96dff5d10e226210e57cfb22282a7df9840f90923608874a67b3c
Oct 30 21:25:35.083427 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:35.083209    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx" event={"ID":"a63fa02a-0d4a-4709-9572-18b57a14a44d","Type":"ContainerStarted","Data":"73e627c6ddcbc764ef92af73c457522484c42b789cfee178985ccb3ea3b25c60"}
Oct 30 21:25:35.083427 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:35.083276    5446 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx" event={"ID":"a63fa02a-0d4a-4709-9572-18b57a14a44d","Type":"ContainerStarted","Data":"a472f623c9e96dff5d10e226210e57cfb22282a7df9840f90923608874a67b3c"}
Oct 30 21:25:35.083970 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:35.083496    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:35.198057 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:35.198004    5446 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx" podStartSLOduration=2.197988473 podStartE2EDuration="2.197988473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:35.196310468 +0000 UTC m=+3501.188313596" watchObservedRunningTime="2026-10-30 21:25:35.197988473 +0000 UTC m=+3501.189991600"
Oct 30 21:25:38.525659 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:38.525629    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/alertmanager/0.log"
Oct 30 21:25:38.948436 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:38.948406    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/config-reloader/0.log"
Oct 30 21:25:39.371021 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:39.370994    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/kube-rbac-proxy-web/0.log"
Oct 30 21:25:39.796564 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:39.796469    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/kube-rbac-proxy/0.log"
Oct 30 21:25:40.219341 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:40.219308    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/kube-rbac-proxy-metric/0.log"
Oct 30 21:25:40.643325 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:40.643297    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/prom-label-proxy/0.log"
Oct 30 21:25:41.067097 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:41.066983    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc44cbbe-c13a-47a3-a833-354a3af5f8bc/init-config-reloader/0.log"
Oct 30 21:25:41.104846 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:41.104813    5446 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x4r57/perf-node-gather-daemonset-sgtpx"
Oct 30 21:25:43.235267 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:43.235215    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f79df684-rfrnc_01c476b7-f6d3-4ca0-bda3-2730fe09e1db/metrics-server/0.log"
Oct 30 21:25:43.660253 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:43.660226    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-92nqc_cf0ec03d-f2fb-449d-808b-a22d38de3a1c/monitoring-plugin/0.log"
Oct 30 21:25:44.088164 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:44.088096    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xvsh_85fec599-5ad3-4971-a4ce-15f46736d55a/node-exporter/0.log"
Oct 30 21:25:44.510182 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:44.510148    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xvsh_85fec599-5ad3-4971-a4ce-15f46736d55a/kube-rbac-proxy/0.log"
Oct 30 21:25:44.935703 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:44.935675    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xvsh_85fec599-5ad3-4971-a4ce-15f46736d55a/init-textfile/0.log"
Oct 30 21:25:49.521902 ip-10-0-135-188 kubenswrapper[5446]: E1030 21:25:49.521867    5446 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x8rwl" containerName="extractor"
Oct 30 21:25:52.200764 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:52.200683    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-7zntm_39c50552-39f0-4be4-9d70-ffade02c476f/prometheus-operator/0.log"
Oct 30 21:25:52.621079 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:52.621051    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-7zntm_39c50552-39f0-4be4-9d70-ffade02c476f/kube-rbac-proxy/0.log"
Oct 30 21:25:53.474034 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:53.474010    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-674f9d7465-lpx8q_252c4068-aec5-4b0e-bab8-e836652aac9a/telemeter-client/0.log"
Oct 30 21:25:53.896891 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:53.896864    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-674f9d7465-lpx8q_252c4068-aec5-4b0e-bab8-e836652aac9a/reload/0.log"
Oct 30 21:25:54.320492 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:54.320422    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-674f9d7465-lpx8q_252c4068-aec5-4b0e-bab8-e836652aac9a/kube-rbac-proxy/0.log"
Oct 30 21:25:54.749266 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:54.749236    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/thanos-query/0.log"
Oct 30 21:25:55.171075 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:55.171045    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/kube-rbac-proxy-web/0.log"
Oct 30 21:25:55.593041 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:55.592966    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/kube-rbac-proxy/0.log"
Oct 30 21:25:56.013329 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:56.013301    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/prom-label-proxy/0.log"
Oct 30 21:25:56.435662 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:56.435635    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/kube-rbac-proxy-rules/0.log"
Oct 30 21:25:56.859872 ip-10-0-135-188 kubenswrapper[5446]: I1030 21:25:56.859795    5446 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-595768c758-7mcq9_869e6098-8b18-4a7c-baa5-f4e2db8f5a97/kube-rbac-proxy-metrics/0.log"